=== RUN   TestFunctional/parallel/MountCmd/specific-port

functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-877284 /tmp/TestFunctionalparallelMountCmdspecific-port4093653475/001:/mount-9p --alsologtostderr -v=1 --port 46464]

functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 ssh "findmnt -T /mount-9p | grep 9p"

functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-877284 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (311.154429ms)

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

I1104 10:41:46.015872    7687 retry.go:31] will retry after 444.259618ms: exit status 1

functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 ssh "findmnt -T /mount-9p | grep 9p"

functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-877284 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (249.048105ms)

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

I1104 10:41:46.709722    7687 retry.go:31] will retry after 717.922234ms: exit status 1

functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 ssh "findmnt -T /mount-9p | grep 9p"

functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-877284 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (276.494377ms)

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

I1104 10:41:47.705302    7687 retry.go:31] will retry after 574.090958ms: exit status 1

functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 ssh "findmnt -T /mount-9p | grep 9p"

functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-877284 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (265.241012ms)

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

I1104 10:41:48.544946    7687 retry.go:31] will retry after 2.273580771s: exit status 1

functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 ssh "findmnt -T /mount-9p | grep 9p"

functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-877284 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (246.573044ms)

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

I1104 10:41:51.065985    7687 retry.go:31] will retry after 3.020064646s: exit status 1

functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 ssh "findmnt -T /mount-9p | grep 9p"

functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-877284 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (265.204579ms)

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

I1104 10:41:54.352240    7687 retry.go:31] will retry after 5.309179725s: exit status 1

functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 ssh "findmnt -T /mount-9p | grep 9p"

functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-877284 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (335.498342ms)

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

functional_test_mount_test.go:253: /mount-9p did not appear within 14.293694572s: exit status 1

functional_test_mount_test.go:220: "TestFunctional/parallel/MountCmd/specific-port" failed, getting debug info...

functional_test_mount_test.go:221: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 ssh "mount | grep 9p; ls -la /mount-9p; cat /mount-9p/pod-dates"

functional_test_mount_test.go:221: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-877284 ssh "mount | grep 9p; ls -la /mount-9p; cat /mount-9p/pod-dates": exit status 1 (660.775963ms)

-- stdout --

	total 8

	drwxr-xr-x 2 root root 4096 Nov  4 10:41 .

	drwxr-xr-x 1 root root 4096 Nov  4 10:41 ..

	cat: /mount-9p/pod-dates: No such file or directory

-- /stdout --

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

functional_test_mount_test.go:223: debugging command "out/minikube-linux-arm64 -p functional-877284 ssh \"mount | grep 9p; ls -la /mount-9p; cat /mount-9p/pod-dates\"" failed : exit status 1

functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 ssh "sudo umount -f /mount-9p"

functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-877284 ssh "sudo umount -f /mount-9p": exit status 1 (307.457197ms)

-- stdout --

	umount: /mount-9p: not mounted.

-- /stdout --

** stderr ** 

	ssh: Process exited with status 32

** /stderr **

functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-877284 ssh \"sudo umount -f /mount-9p\"": exit status 1

functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-877284 /tmp/TestFunctionalparallelMountCmdspecific-port4093653475/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...

functional_test_mount_test.go:234: (dbg) [out/minikube-linux-arm64 mount -p functional-877284 /tmp/TestFunctionalparallelMountCmdspecific-port4093653475/001:/mount-9p --alsologtostderr -v=1 --port 46464] stdout:

* Mounting host path /tmp/TestFunctionalparallelMountCmdspecific-port4093653475/001 into VM as /mount-9p ...

- Mount type:   9p

- User ID:      docker

- Group ID:     docker

- Version:      9p2000.L

- Message Size: 262144

- Options:      map[]

- Bind Address: 192.168.49.1:46464

* Userspace file server: ufs starting

* Userspace file server is shutdown

functional_test_mount_test.go:234: (dbg) [out/minikube-linux-arm64 mount -p functional-877284 /tmp/TestFunctionalparallelMountCmdspecific-port4093653475/001:/mount-9p --alsologtostderr -v=1 --port 46464] stderr:

I1104 10:41:45.764651   44416 out.go:345] Setting OutFile to fd 1 ...

I1104 10:41:45.764883   44416 out.go:392] TERM=,COLORTERM=, which probably does not support color

I1104 10:41:45.764901   44416 out.go:358] Setting ErrFile to fd 2...

I1104 10:41:45.764916   44416 out.go:392] TERM=,COLORTERM=, which probably does not support color

I1104 10:41:45.765172   44416 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19906-2243/.minikube/bin

I1104 10:41:45.765588   44416 mustload.go:65] Loading cluster: functional-877284

I1104 10:41:45.766089   44416 config.go:182] Loaded profile config "functional-877284": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2

I1104 10:41:45.766771   44416 cli_runner.go:164] Run: docker container inspect functional-877284 --format={{.State.Status}}

I1104 10:41:45.787322   44416 host.go:66] Checking if "functional-877284" exists ...

I1104 10:41:45.787649   44416 cli_runner.go:164] Run: docker system info --format "{{json .}}"

I1104 10:41:45.869011   44416 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:32 OomKillDisable:true NGoroutines:52 SystemTime:2024-11-04 10:41:45.857470993 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aa

rch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge-

nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}

I1104 10:41:45.869165   44416 cli_runner.go:164] Run: docker network inspect functional-877284 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

I1104 10:41:45.895595   44416 out.go:177] * Mounting host path /tmp/TestFunctionalparallelMountCmdspecific-port4093653475/001 into VM as /mount-9p ...

I1104 10:41:45.897891   44416 out.go:177]   - Mount type:   9p

I1104 10:41:45.900052   44416 out.go:177]   - User ID:      docker

I1104 10:41:45.902281   44416 out.go:177]   - Group ID:     docker

I1104 10:41:45.904317   44416 out.go:177]   - Version:      9p2000.L

I1104 10:41:45.906626   44416 out.go:177]   - Message Size: 262144

I1104 10:41:45.908503   44416 out.go:177]   - Options:      map[]

I1104 10:41:45.911553   44416 out.go:177]   - Bind Address: 192.168.49.1:46464

I1104 10:41:45.913665   44416 out.go:177] * Userspace file server: 

I1104 10:41:45.914615   44416 ssh_runner.go:195] Run: /bin/bash -c "[ "x$(findmnt -T /mount-9p | grep /mount-9p)" != "x" ] && sudo umount -f /mount-9p || echo "

I1104 10:41:45.914720   44416 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-877284

I1104 10:41:45.915851   44416 main.go:125] stdlog: ufs.go:27 listen tcp 192.168.49.1:46464: bind: address already in use

I1104 10:41:45.918058   44416 out.go:177] * Userspace file server is shutdown

I1104 10:41:45.940226   44416 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/functional-877284/id_rsa Username:docker}

I1104 10:41:46.038199   44416 mount.go:180] unmount for /mount-9p ran successfully

I1104 10:41:46.038231   44416 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /mount-9p"

I1104 10:41:46.048189   44416 ssh_runner.go:195] Run: /bin/bash -c "sudo mount -t 9p -o dfltgid=$(grep ^docker: /etc/group | cut -d: -f3),dfltuid=$(id -u docker),msize=262144,port=46464,trans=tcp,version=9p2000.L 192.168.49.1 /mount-9p"

I1104 10:41:46.066167   44416 out.go:201] 

W1104 10:41:46.068095   44416 out.go:270] X Exiting due to GUEST_MOUNT: mount failed: mount with cmd /bin/bash -c "sudo mount -t 9p -o dfltgid=$(grep ^docker: /etc/group | cut -d: -f3),dfltuid=$(id -u docker),msize=262144,port=46464,trans=tcp,version=9p2000.L 192.168.49.1 /mount-9p" : /bin/bash -c "sudo mount -t 9p -o dfltgid=$(grep ^docker: /etc/group | cut -d: -f3),dfltuid=$(id -u docker),msize=262144,port=46464,trans=tcp,version=9p2000.L 192.168.49.1 /mount-9p": Process exited with status 32

stdout:

stderr:

mount: /mount-9p: mount(2) system call failed: Connection refused.

X Exiting due to GUEST_MOUNT: mount failed: mount with cmd /bin/bash -c "sudo mount -t 9p -o dfltgid=$(grep ^docker: /etc/group | cut -d: -f3),dfltuid=$(id -u docker),msize=262144,port=46464,trans=tcp,version=9p2000.L 192.168.49.1 /mount-9p" : /bin/bash -c "sudo mount -t 9p -o dfltgid=$(grep ^docker: /etc/group | cut -d: -f3),dfltuid=$(id -u docker),msize=262144,port=46464,trans=tcp,version=9p2000.L 192.168.49.1 /mount-9p": Process exited with status 32

stdout:

stderr:

mount: /mount-9p: mount(2) system call failed: Connection refused.

W1104 10:41:46.068125   44416 out.go:270] * 

* 

W1104 10:41:46.070298   44416 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                             │

│    * If the above advice does not help, please let us know:                                 │

│      https://github.com/kubernetes/minikube/issues/new/choose                               │

│                                                                                             │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

│    * Please also attach the following file to the GitHub issue:                             │

│    * - /tmp/minikube_mount_16a7ba96df88cb3181635dd7faed596e5ce4e552_0.log                   │

│                                                                                             │

╰─────────────────────────────────────────────────────────────────────────────────────────────╯

╭─────────────────────────────────────────────────────────────────────────────────────────────╮

│                                                                                             │

│    * If the above advice does not help, please let us know:                                 │

│      https://github.com/kubernetes/minikube/issues/new/choose                               │

│                                                                                             │

│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

│    * Please also attach the following file to the GitHub issue:                             │

│    * - /tmp/minikube_mount_16a7ba96df88cb3181635dd7faed596e5ce4e552_0.log                   │

│                                                                                             │

╰─────────────────────────────────────────────────────────────────────────────────────────────╯

I1104 10:41:46.072398   44416 out.go:201] 

--- FAIL: TestFunctional/parallel/MountCmd/specific-port (15.37s)

=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart

start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-500235 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0

start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-500235 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m20.823684804s)

-- stdout --

	* [old-k8s-version-500235] minikube v1.34.0 on Ubuntu 20.04 (arm64)

	  - MINIKUBE_LOCATION=19906

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/19906-2243/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19906-2243/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-arm64

	  - MINIKUBE_FORCE_SYSTEMD=

	* Kubernetes 1.31.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.2

	* Using the docker driver based on existing profile

	* Starting "old-k8s-version-500235" primary control-plane node in "old-k8s-version-500235" cluster

	* Pulling base image v0.0.45-1730282848-19883 ...

	* Restarting existing docker container for "old-k8s-version-500235" ...

	* Preparing Kubernetes v1.20.0 on containerd 1.7.22 ...

	* Verifying Kubernetes components...

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	  - Using image fake.domain/registry.k8s.io/echoserver:1.4

	  - Using image docker.io/kubernetesui/dashboard:v2.7.0

	  - Using image registry.k8s.io/echoserver:1.4

	* Some dashboard features require the metrics-server addon. To enable all features please run:

		minikube -p old-k8s-version-500235 addons enable metrics-server

	* Enabled addons: metrics-server, storage-provisioner, default-storageclass, dashboard

-- /stdout --

** stderr ** 

	I1104 11:18:11.187940  214454 out.go:345] Setting OutFile to fd 1 ...

	I1104 11:18:11.188114  214454 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1104 11:18:11.188134  214454 out.go:358] Setting ErrFile to fd 2...

	I1104 11:18:11.188143  214454 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1104 11:18:11.189121  214454 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19906-2243/.minikube/bin

	I1104 11:18:11.189574  214454 out.go:352] Setting JSON to false

	I1104 11:18:11.190426  214454 start.go:129] hostinfo: {"hostname":"ip-172-31-24-2","uptime":3643,"bootTime":1730715449,"procs":186,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"6d436adf-771e-4269-b9a3-c25fd4fca4f5"}

	I1104 11:18:11.190593  214454 start.go:139] virtualization:  

	I1104 11:18:11.193653  214454 out.go:177] * [old-k8s-version-500235] minikube v1.34.0 on Ubuntu 20.04 (arm64)

	I1104 11:18:11.196618  214454 out.go:177]   - MINIKUBE_LOCATION=19906

	I1104 11:18:11.197047  214454 notify.go:220] Checking for updates...

	I1104 11:18:11.201293  214454 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1104 11:18:11.203672  214454 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19906-2243/kubeconfig

	I1104 11:18:11.205850  214454 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19906-2243/.minikube

	I1104 11:18:11.207920  214454 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64

	I1104 11:18:11.210608  214454 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1104 11:18:11.213430  214454 config.go:182] Loaded profile config "old-k8s-version-500235": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I1104 11:18:11.216097  214454 out.go:177] * Kubernetes 1.31.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.2

	I1104 11:18:11.218280  214454 driver.go:394] Setting default libvirt URI to qemu:///system

	I1104 11:18:11.248391  214454 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community

	I1104 11:18:11.248514  214454 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1104 11:18:11.307024  214454 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:37 OomKillDisable:true NGoroutines:52 SystemTime:2024-11-04 11:18:11.297313514 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a

arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge

-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}

	I1104 11:18:11.307135  214454 docker.go:318] overlay module found

	I1104 11:18:11.309775  214454 out.go:177] * Using the docker driver based on existing profile

	I1104 11:18:11.312244  214454 start.go:297] selected driver: docker

	I1104 11:18:11.312267  214454 start.go:901] validating driver "docker" against &{Name:old-k8s-version-500235 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-500235 Namespace:default APIServerHAVIP: AP

IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa

lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1104 11:18:11.312376  214454 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1104 11:18:11.313125  214454 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1104 11:18:11.381310  214454 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:37 OomKillDisable:true NGoroutines:52 SystemTime:2024-11-04 11:18:11.364397864 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a

arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge

-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}

	I1104 11:18:11.381710  214454 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1104 11:18:11.381740  214454 cni.go:84] Creating CNI manager for ""

	I1104 11:18:11.381784  214454 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet

	I1104 11:18:11.381831  214454 start.go:340] cluster config:

	{Name:old-k8s-version-500235 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-500235 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local

ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do

cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1104 11:18:11.384887  214454 out.go:177] * Starting "old-k8s-version-500235" primary control-plane node in "old-k8s-version-500235" cluster

	I1104 11:18:11.387471  214454 cache.go:121] Beginning downloading kic base image for docker with containerd

	I1104 11:18:11.389999  214454 out.go:177] * Pulling base image v0.0.45-1730282848-19883 ...

	I1104 11:18:11.392381  214454 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd

	I1104 11:18:11.392441  214454 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19906-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4

	I1104 11:18:11.392455  214454 cache.go:56] Caching tarball of preloaded images

	I1104 11:18:11.392461  214454 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 in local docker daemon

	I1104 11:18:11.392559  214454 preload.go:172] Found /home/jenkins/minikube-integration/19906-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download

	I1104 11:18:11.392570  214454 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd

	I1104 11:18:11.392697  214454 profile.go:143] Saving config to /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/old-k8s-version-500235/config.json ...

	I1104 11:18:11.413400  214454 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 in local docker daemon, skipping pull

	I1104 11:18:11.413425  214454 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 exists in daemon, skipping load

	I1104 11:18:11.413452  214454 cache.go:194] Successfully downloaded all kic artifacts

	I1104 11:18:11.413497  214454 start.go:360] acquireMachinesLock for old-k8s-version-500235: {Name:mk17326ae7c89d246043fd226cb6bf0183a2831f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1104 11:18:11.413589  214454 start.go:364] duration metric: took 60.479µs to acquireMachinesLock for "old-k8s-version-500235"

	I1104 11:18:11.413617  214454 start.go:96] Skipping create...Using existing machine configuration

	I1104 11:18:11.413632  214454 fix.go:54] fixHost starting: 

	I1104 11:18:11.413946  214454 cli_runner.go:164] Run: docker container inspect old-k8s-version-500235 --format={{.State.Status}}

	I1104 11:18:11.430636  214454 fix.go:112] recreateIfNeeded on old-k8s-version-500235: state=Stopped err=<nil>

	W1104 11:18:11.430673  214454 fix.go:138] unexpected machine state, will restart: <nil>

	I1104 11:18:11.433352  214454 out.go:177] * Restarting existing docker container for "old-k8s-version-500235" ...

	I1104 11:18:11.435563  214454 cli_runner.go:164] Run: docker start old-k8s-version-500235

	I1104 11:18:11.715454  214454 cli_runner.go:164] Run: docker container inspect old-k8s-version-500235 --format={{.State.Status}}

	I1104 11:18:11.739601  214454 kic.go:430] container "old-k8s-version-500235" state is running.

	I1104 11:18:11.739999  214454 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-500235

	I1104 11:18:11.761572  214454 profile.go:143] Saving config to /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/old-k8s-version-500235/config.json ...

	I1104 11:18:11.761800  214454 machine.go:93] provisionDockerMachine start ...

	I1104 11:18:11.761861  214454 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-500235

	I1104 11:18:11.782549  214454 main.go:141] libmachine: Using SSH client type: native

	I1104 11:18:11.782969  214454 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x415580] 0x417dc0 <nil>  [] 0s} 127.0.0.1 33063 <nil> <nil>}

	I1104 11:18:11.782993  214454 main.go:141] libmachine: About to run SSH command:

	hostname

	I1104 11:18:11.783702  214454 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF

	I1104 11:18:14.914257  214454 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-500235

	I1104 11:18:14.914282  214454 ubuntu.go:169] provisioning hostname "old-k8s-version-500235"

	I1104 11:18:14.914360  214454 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-500235

	I1104 11:18:14.937604  214454 main.go:141] libmachine: Using SSH client type: native

	I1104 11:18:14.937851  214454 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x415580] 0x417dc0 <nil>  [] 0s} 127.0.0.1 33063 <nil> <nil>}

	I1104 11:18:14.937868  214454 main.go:141] libmachine: About to run SSH command:

	sudo hostname old-k8s-version-500235 && echo "old-k8s-version-500235" | sudo tee /etc/hostname

	I1104 11:18:15.098148  214454 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-500235

	I1104 11:18:15.098259  214454 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-500235

	I1104 11:18:15.129962  214454 main.go:141] libmachine: Using SSH client type: native

	I1104 11:18:15.130244  214454 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x415580] 0x417dc0 <nil>  [] 0s} 127.0.0.1 33063 <nil> <nil>}

	I1104 11:18:15.130271  214454 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sold-k8s-version-500235' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-500235/g' /etc/hosts;

				else 

					echo '127.0.1.1 old-k8s-version-500235' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1104 11:18:15.278444  214454 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1104 11:18:15.278559  214454 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19906-2243/.minikube CaCertPath:/home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19906-2243/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19906-2243/.minikube}

	I1104 11:18:15.278600  214454 ubuntu.go:177] setting up certificates

	I1104 11:18:15.278624  214454 provision.go:84] configureAuth start

	I1104 11:18:15.278733  214454 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-500235

	I1104 11:18:15.300176  214454 provision.go:143] copyHostCerts

	I1104 11:18:15.300266  214454 exec_runner.go:144] found /home/jenkins/minikube-integration/19906-2243/.minikube/ca.pem, removing ...

	I1104 11:18:15.300297  214454 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19906-2243/.minikube/ca.pem

	I1104 11:18:15.300363  214454 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19906-2243/.minikube/ca.pem (1082 bytes)

	I1104 11:18:15.300466  214454 exec_runner.go:144] found /home/jenkins/minikube-integration/19906-2243/.minikube/cert.pem, removing ...

	I1104 11:18:15.300474  214454 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19906-2243/.minikube/cert.pem

	I1104 11:18:15.300495  214454 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19906-2243/.minikube/cert.pem (1123 bytes)

	I1104 11:18:15.300543  214454 exec_runner.go:144] found /home/jenkins/minikube-integration/19906-2243/.minikube/key.pem, removing ...

	I1104 11:18:15.300553  214454 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19906-2243/.minikube/key.pem

	I1104 11:18:15.300572  214454 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19906-2243/.minikube/key.pem (1679 bytes)

	I1104 11:18:15.300625  214454 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19906-2243/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-500235 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-500235]

	I1104 11:18:16.363043  214454 provision.go:177] copyRemoteCerts

	I1104 11:18:16.363119  214454 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1104 11:18:16.363174  214454 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-500235

	I1104 11:18:16.383273  214454 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/old-k8s-version-500235/id_rsa Username:docker}

	I1104 11:18:16.479315  214454 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1104 11:18:16.502916  214454 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)

	I1104 11:18:16.527598  214454 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I1104 11:18:16.554666  214454 provision.go:87] duration metric: took 1.276018318s to configureAuth

	I1104 11:18:16.554697  214454 ubuntu.go:193] setting minikube options for container-runtime

	I1104 11:18:16.554886  214454 config.go:182] Loaded profile config "old-k8s-version-500235": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I1104 11:18:16.554900  214454 machine.go:96] duration metric: took 4.79308776s to provisionDockerMachine

	I1104 11:18:16.554908  214454 start.go:293] postStartSetup for "old-k8s-version-500235" (driver="docker")

	I1104 11:18:16.554918  214454 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1104 11:18:16.554973  214454 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1104 11:18:16.555016  214454 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-500235

	I1104 11:18:16.588275  214454 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/old-k8s-version-500235/id_rsa Username:docker}

	I1104 11:18:16.684563  214454 ssh_runner.go:195] Run: cat /etc/os-release

	I1104 11:18:16.689026  214454 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1104 11:18:16.689077  214454 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1104 11:18:16.689089  214454 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1104 11:18:16.689104  214454 info.go:137] Remote host: Ubuntu 22.04.5 LTS

	I1104 11:18:16.689120  214454 filesync.go:126] Scanning /home/jenkins/minikube-integration/19906-2243/.minikube/addons for local assets ...

	I1104 11:18:16.689175  214454 filesync.go:126] Scanning /home/jenkins/minikube-integration/19906-2243/.minikube/files for local assets ...

	I1104 11:18:16.689268  214454 filesync.go:149] local asset: /home/jenkins/minikube-integration/19906-2243/.minikube/files/etc/ssl/certs/76872.pem -> 76872.pem in /etc/ssl/certs

	I1104 11:18:16.689380  214454 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1104 11:18:16.698718  214454 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/files/etc/ssl/certs/76872.pem --> /etc/ssl/certs/76872.pem (1708 bytes)

	I1104 11:18:16.724192  214454 start.go:296] duration metric: took 169.269031ms for postStartSetup

	I1104 11:18:16.724277  214454 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1104 11:18:16.724322  214454 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-500235

	I1104 11:18:16.758877  214454 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/old-k8s-version-500235/id_rsa Username:docker}

	I1104 11:18:16.859446  214454 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1104 11:18:16.864769  214454 fix.go:56] duration metric: took 5.451134487s for fixHost

	I1104 11:18:16.864793  214454 start.go:83] releasing machines lock for "old-k8s-version-500235", held for 5.451191027s

	I1104 11:18:16.864854  214454 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-500235

	I1104 11:18:16.884516  214454 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1104 11:18:16.884613  214454 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-500235

	I1104 11:18:16.884768  214454 ssh_runner.go:195] Run: cat /version.json

	I1104 11:18:16.884810  214454 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-500235

	I1104 11:18:16.903037  214454 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/old-k8s-version-500235/id_rsa Username:docker}

	I1104 11:18:16.927935  214454 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/old-k8s-version-500235/id_rsa Username:docker}

	I1104 11:18:17.133646  214454 ssh_runner.go:195] Run: systemctl --version

	I1104 11:18:17.139129  214454 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1104 11:18:17.144059  214454 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;

	I1104 11:18:17.165457  214454 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found

	I1104 11:18:17.165568  214454 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1104 11:18:17.175461  214454 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable

	I1104 11:18:17.175552  214454 start.go:495] detecting cgroup driver to use...

	I1104 11:18:17.175599  214454 detect.go:187] detected "cgroupfs" cgroup driver on host os

	I1104 11:18:17.175669  214454 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I1104 11:18:17.192486  214454 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1104 11:18:17.207281  214454 docker.go:217] disabling cri-docker service (if available) ...

	I1104 11:18:17.207350  214454 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I1104 11:18:17.221168  214454 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I1104 11:18:17.233811  214454 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I1104 11:18:17.364687  214454 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I1104 11:18:17.505373  214454 docker.go:233] disabling docker service ...

	I1104 11:18:17.505462  214454 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I1104 11:18:17.521901  214454 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I1104 11:18:17.537098  214454 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I1104 11:18:17.650105  214454 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I1104 11:18:17.758418  214454 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1104 11:18:17.771748  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1104 11:18:17.789044  214454 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"

	I1104 11:18:17.798998  214454 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1104 11:18:17.809248  214454 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I1104 11:18:17.809395  214454 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1104 11:18:17.819088  214454 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1104 11:18:17.829529  214454 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1104 11:18:17.839787  214454 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1104 11:18:17.849755  214454 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1104 11:18:17.859555  214454 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1104 11:18:17.869412  214454 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1104 11:18:17.879108  214454 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1104 11:18:17.888286  214454 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1104 11:18:17.992308  214454 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1104 11:18:18.202597  214454 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock

	I1104 11:18:18.202679  214454 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock

	I1104 11:18:18.206921  214454 start.go:563] Will wait 60s for crictl version

	I1104 11:18:18.206999  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:18:18.210718  214454 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1104 11:18:18.290257  214454 start.go:579] Version:  0.1.0

	RuntimeName:  containerd

	RuntimeVersion:  1.7.22

	RuntimeApiVersion:  v1

	I1104 11:18:18.290336  214454 ssh_runner.go:195] Run: containerd --version

	I1104 11:18:18.312603  214454 ssh_runner.go:195] Run: containerd --version

	I1104 11:18:18.338404  214454 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.22 ...

	I1104 11:18:18.340454  214454 cli_runner.go:164] Run: docker network inspect old-k8s-version-500235 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1104 11:18:18.356481  214454 ssh_runner.go:195] Run: grep 192.168.85.1	host.minikube.internal$ /etc/hosts

	I1104 11:18:18.360245  214454 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1104 11:18:18.370272  214454 kubeadm.go:883] updating cluster {Name:old-k8s-version-500235 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-500235 Namespace:default APIServerHAVIP: APIServerName:minik

ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/

home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I1104 11:18:18.370390  214454 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd

	I1104 11:18:18.370455  214454 ssh_runner.go:195] Run: sudo crictl images --output json

	I1104 11:18:18.418825  214454 containerd.go:627] all images are preloaded for containerd runtime.

	I1104 11:18:18.418852  214454 containerd.go:534] Images already preloaded, skipping extraction

	I1104 11:18:18.418908  214454 ssh_runner.go:195] Run: sudo crictl images --output json

	I1104 11:18:18.463034  214454 containerd.go:627] all images are preloaded for containerd runtime.

	I1104 11:18:18.463064  214454 cache_images.go:84] Images are preloaded, skipping loading

	I1104 11:18:18.463072  214454 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.20.0 containerd true true} ...

	I1104 11:18:18.463209  214454 kubeadm.go:946] kubelet [Unit]

	Wants=containerd.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-500235 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.85.2

	[Install]

	 config:

	{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-500235 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I1104 11:18:18.463285  214454 ssh_runner.go:195] Run: sudo crictl info

	I1104 11:18:18.503818  214454 cni.go:84] Creating CNI manager for ""

	I1104 11:18:18.503848  214454 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet

	I1104 11:18:18.503860  214454 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I1104 11:18:18.503880  214454 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-500235 NodeName:old-k8s-version-500235 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt

StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}

	I1104 11:18:18.504008  214454 kubeadm.go:195] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.85.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /run/containerd/containerd.sock

	  name: "old-k8s-version-500235"

	  kubeletExtraArgs:

	    node-ip: 192.168.85.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta2

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	dns:

	  type: CoreDNS

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.20.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1104 11:18:18.504077  214454 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0

	I1104 11:18:18.513700  214454 binaries.go:44] Found k8s binaries, skipping transfer

	I1104 11:18:18.513772  214454 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1104 11:18:18.523106  214454 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)

	I1104 11:18:18.542239  214454 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1104 11:18:18.561499  214454 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)

	I1104 11:18:18.580551  214454 ssh_runner.go:195] Run: grep 192.168.85.2	control-plane.minikube.internal$ /etc/hosts

	I1104 11:18:18.584077  214454 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1104 11:18:18.594952  214454 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1104 11:18:18.704328  214454 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1104 11:18:18.720585  214454 certs.go:68] Setting up /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/old-k8s-version-500235 for IP: 192.168.85.2

	I1104 11:18:18.720609  214454 certs.go:194] generating shared ca certs ...

	I1104 11:18:18.720625  214454 certs.go:226] acquiring lock for ca certs: {Name:mkd977a3ad99222c5fc8a72aa0efe5fbfd33dbdc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1104 11:18:18.720771  214454 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19906-2243/.minikube/ca.key

	I1104 11:18:18.720819  214454 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19906-2243/.minikube/proxy-client-ca.key

	I1104 11:18:18.720831  214454 certs.go:256] generating profile certs ...

	I1104 11:18:18.720915  214454 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/old-k8s-version-500235/client.key

	I1104 11:18:18.720985  214454 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/old-k8s-version-500235/apiserver.key.97b3d55f

	I1104 11:18:18.721031  214454 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/old-k8s-version-500235/proxy-client.key

	I1104 11:18:18.721149  214454 certs.go:484] found cert: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/7687.pem (1338 bytes)

	W1104 11:18:18.721182  214454 certs.go:480] ignoring /home/jenkins/minikube-integration/19906-2243/.minikube/certs/7687_empty.pem, impossibly tiny 0 bytes

	I1104 11:18:18.721195  214454 certs.go:484] found cert: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca-key.pem (1679 bytes)

	I1104 11:18:18.721222  214454 certs.go:484] found cert: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca.pem (1082 bytes)

	I1104 11:18:18.721249  214454 certs.go:484] found cert: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/cert.pem (1123 bytes)

	I1104 11:18:18.721274  214454 certs.go:484] found cert: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/key.pem (1679 bytes)

	I1104 11:18:18.721321  214454 certs.go:484] found cert: /home/jenkins/minikube-integration/19906-2243/.minikube/files/etc/ssl/certs/76872.pem (1708 bytes)

	I1104 11:18:18.721930  214454 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1104 11:18:18.749321  214454 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I1104 11:18:18.775058  214454 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1104 11:18:18.802121  214454 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1104 11:18:18.840921  214454 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/old-k8s-version-500235/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)

	I1104 11:18:18.898983  214454 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/old-k8s-version-500235/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I1104 11:18:18.949165  214454 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/old-k8s-version-500235/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1104 11:18:18.999174  214454 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/old-k8s-version-500235/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1104 11:18:19.031244  214454 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/certs/7687.pem --> /usr/share/ca-certificates/7687.pem (1338 bytes)

	I1104 11:18:19.058151  214454 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/files/etc/ssl/certs/76872.pem --> /usr/share/ca-certificates/76872.pem (1708 bytes)

	I1104 11:18:19.084416  214454 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1104 11:18:19.109898  214454 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1104 11:18:19.129334  214454 ssh_runner.go:195] Run: openssl version

	I1104 11:18:19.135162  214454 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/76872.pem && ln -fs /usr/share/ca-certificates/76872.pem /etc/ssl/certs/76872.pem"

	I1104 11:18:19.145110  214454 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/76872.pem

	I1104 11:18:19.149033  214454 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov  4 10:39 /usr/share/ca-certificates/76872.pem

	I1104 11:18:19.149155  214454 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/76872.pem

	I1104 11:18:19.156489  214454 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/76872.pem /etc/ssl/certs/3ec20f2e.0"

	I1104 11:18:19.166148  214454 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1104 11:18:19.175975  214454 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1104 11:18:19.179941  214454 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov  4 10:31 /usr/share/ca-certificates/minikubeCA.pem

	I1104 11:18:19.180055  214454 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1104 11:18:19.187359  214454 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1104 11:18:19.197888  214454 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7687.pem && ln -fs /usr/share/ca-certificates/7687.pem /etc/ssl/certs/7687.pem"

	I1104 11:18:19.207766  214454 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7687.pem

	I1104 11:18:19.211612  214454 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov  4 10:39 /usr/share/ca-certificates/7687.pem

	I1104 11:18:19.211736  214454 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7687.pem

	I1104 11:18:19.218589  214454 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7687.pem /etc/ssl/certs/51391683.0"

	I1104 11:18:19.227949  214454 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1104 11:18:19.231721  214454 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I1104 11:18:19.238501  214454 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I1104 11:18:19.245664  214454 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I1104 11:18:19.252865  214454 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I1104 11:18:19.259893  214454 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I1104 11:18:19.266992  214454 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I1104 11:18:19.273998  214454 kubeadm.go:392] StartCluster: {Name:old-k8s-version-500235 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-500235 Namespace:default APIServerHAVIP: APIServerName:minikube

CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom

e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1104 11:18:19.274148  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}

	I1104 11:18:19.274231  214454 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I1104 11:18:19.322478  214454 cri.go:89] found id: "0eacea8f30c21c6e37db05c925c230cf081403ce010879dec3222a7e8391570a"

	I1104 11:18:19.322571  214454 cri.go:89] found id: "55de0e155bc4227fa1a7b7fbfa0a89934a702ea6e0398a4160b6f36cd9f30f1d"

	I1104 11:18:19.322591  214454 cri.go:89] found id: "fc09d0e1fa4f14f05991c8b8c3438c3bdb96a60ab5c3e5a2a09c52aa731bf5de"

	I1104 11:18:19.322611  214454 cri.go:89] found id: "e6255db4359d2fc972f43b37d6434c4571e71ddfe5bd608725f16a5f12803e0e"

	I1104 11:18:19.322644  214454 cri.go:89] found id: "315609310246fb02d41baadc72115323d45bf3a159131f75ebbe409d29d740e3"

	I1104 11:18:19.322662  214454 cri.go:89] found id: "5fc8337da03458cb82a696381c08decbec20e515a804b7d3039041c61f734ae0"

	I1104 11:18:19.322686  214454 cri.go:89] found id: "5f9f6f643b47c2d78af3cabb479505c7d022b211d718f21f9722f20f23462507"

	I1104 11:18:19.322705  214454 cri.go:89] found id: "af8993ac19ddbf1c1b079010f12b22dd569c1d72a7170c14f6d752544c637c7c"

	I1104 11:18:19.322734  214454 cri.go:89] found id: ""

	I1104 11:18:19.322811  214454 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json

	I1104 11:18:19.335644  214454 cri.go:116] JSON = null

	W1104 11:18:19.335736  214454 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8

	I1104 11:18:19.335819  214454 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1104 11:18:19.345826  214454 kubeadm.go:408] found existing configuration files, will attempt cluster restart

	I1104 11:18:19.345893  214454 kubeadm.go:593] restartPrimaryControlPlane start ...

	I1104 11:18:19.345969  214454 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1104 11:18:19.355216  214454 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1104 11:18:19.355749  214454 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-500235" does not appear in /home/jenkins/minikube-integration/19906-2243/kubeconfig

	I1104 11:18:19.355910  214454 kubeconfig.go:62] /home/jenkins/minikube-integration/19906-2243/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-500235" cluster setting kubeconfig missing "old-k8s-version-500235" context setting]

	I1104 11:18:19.356270  214454 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19906-2243/kubeconfig: {Name:mkc050596852ce794c8dfb974431594de1e17faf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1104 11:18:19.357825  214454 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1104 11:18:19.367353  214454 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.85.2

	I1104 11:18:19.367430  214454 kubeadm.go:597] duration metric: took 21.518063ms to restartPrimaryControlPlane

	I1104 11:18:19.367455  214454 kubeadm.go:394] duration metric: took 93.465355ms to StartCluster

	I1104 11:18:19.367492  214454 settings.go:142] acquiring lock: {Name:mkc3202f444103824e9545034754768e014f6744 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1104 11:18:19.367573  214454 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19906-2243/kubeconfig

	I1104 11:18:19.368284  214454 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19906-2243/kubeconfig: {Name:mkc050596852ce794c8dfb974431594de1e17faf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1104 11:18:19.368537  214454 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}

	I1104 11:18:19.368913  214454 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I1104 11:18:19.368988  214454 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-500235"

	I1104 11:18:19.369004  214454 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-500235"

	W1104 11:18:19.369011  214454 addons.go:243] addon storage-provisioner should already be in state true

	I1104 11:18:19.369032  214454 host.go:66] Checking if "old-k8s-version-500235" exists ...

	I1104 11:18:19.369667  214454 cli_runner.go:164] Run: docker container inspect old-k8s-version-500235 --format={{.State.Status}}

	I1104 11:18:19.370050  214454 config.go:182] Loaded profile config "old-k8s-version-500235": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I1104 11:18:19.370138  214454 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-500235"

	I1104 11:18:19.370175  214454 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-500235"

	I1104 11:18:19.370453  214454 cli_runner.go:164] Run: docker container inspect old-k8s-version-500235 --format={{.State.Status}}

	I1104 11:18:19.371055  214454 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-500235"

	I1104 11:18:19.371117  214454 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-500235"

	W1104 11:18:19.371127  214454 addons.go:243] addon metrics-server should already be in state true

	I1104 11:18:19.371151  214454 host.go:66] Checking if "old-k8s-version-500235" exists ...

	I1104 11:18:19.371597  214454 cli_runner.go:164] Run: docker container inspect old-k8s-version-500235 --format={{.State.Status}}

	I1104 11:18:19.373915  214454 addons.go:69] Setting dashboard=true in profile "old-k8s-version-500235"

	I1104 11:18:19.373937  214454 addons.go:234] Setting addon dashboard=true in "old-k8s-version-500235"

	W1104 11:18:19.373944  214454 addons.go:243] addon dashboard should already be in state true

	I1104 11:18:19.373987  214454 host.go:66] Checking if "old-k8s-version-500235" exists ...

	I1104 11:18:19.374396  214454 cli_runner.go:164] Run: docker container inspect old-k8s-version-500235 --format={{.State.Status}}

	I1104 11:18:19.375812  214454 out.go:177] * Verifying Kubernetes components...

	I1104 11:18:19.379046  214454 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1104 11:18:19.432045  214454 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1104 11:18:19.432130  214454 out.go:177]   - Using image fake.domain/registry.k8s.io/echoserver:1.4

	I1104 11:18:19.436424  214454 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1104 11:18:19.436449  214454 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1104 11:18:19.436522  214454 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-500235

	I1104 11:18:19.436719  214454 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I1104 11:18:19.436731  214454 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I1104 11:18:19.436781  214454 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-500235

	I1104 11:18:19.440517  214454 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-500235"

	W1104 11:18:19.440541  214454 addons.go:243] addon default-storageclass should already be in state true

	I1104 11:18:19.440566  214454 host.go:66] Checking if "old-k8s-version-500235" exists ...

	I1104 11:18:19.440968  214454 cli_runner.go:164] Run: docker container inspect old-k8s-version-500235 --format={{.State.Status}}

	I1104 11:18:19.457794  214454 out.go:177]   - Using image docker.io/kubernetesui/dashboard:v2.7.0

	I1104 11:18:19.459987  214454 out.go:177]   - Using image registry.k8s.io/echoserver:1.4

	I1104 11:18:19.462257  214454 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml

	I1104 11:18:19.462281  214454 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)

	I1104 11:18:19.462344  214454 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-500235

	I1104 11:18:19.498288  214454 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/old-k8s-version-500235/id_rsa Username:docker}

	I1104 11:18:19.499748  214454 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/old-k8s-version-500235/id_rsa Username:docker}

	I1104 11:18:19.513449  214454 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I1104 11:18:19.513470  214454 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1104 11:18:19.513529  214454 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-500235

	I1104 11:18:19.538672  214454 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/old-k8s-version-500235/id_rsa Username:docker}

	I1104 11:18:19.558211  214454 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33063 SSHKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/old-k8s-version-500235/id_rsa Username:docker}

	I1104 11:18:19.650985  214454 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1104 11:18:19.663770  214454 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-500235" to be "Ready" ...

	I1104 11:18:19.688832  214454 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I1104 11:18:19.688853  214454 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)

	I1104 11:18:19.703140  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1104 11:18:19.758941  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1104 11:18:19.777222  214454 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I1104 11:18:19.777308  214454 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I1104 11:18:19.797110  214454 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml

	I1104 11:18:19.797175  214454 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)

	I1104 11:18:19.860990  214454 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml

	I1104 11:18:19.861060  214454 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)

	I1104 11:18:19.882349  214454 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I1104 11:18:19.882419  214454 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I1104 11:18:19.952979  214454 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml

	I1104 11:18:19.953050  214454 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)

	I1104 11:18:20.009441  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I1104 11:18:20.037684  214454 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml

	I1104 11:18:20.037762  214454 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)

	W1104 11:18:20.097630  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:20.097715  214454 retry.go:31] will retry after 191.894625ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	W1104 11:18:20.113865  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:20.113959  214454 retry.go:31] will retry after 184.718254ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:20.120816  214454 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml

	I1104 11:18:20.120883  214454 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)

	I1104 11:18:20.200780  214454 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml

	I1104 11:18:20.200852  214454 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)

	I1104 11:18:20.235385  214454 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml

	I1104 11:18:20.235455  214454 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)

	W1104 11:18:20.239465  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:20.239541  214454 retry.go:31] will retry after 242.90828ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:20.259127  214454 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml

	I1104 11:18:20.259205  214454 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)

	I1104 11:18:20.279151  214454 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml

	I1104 11:18:20.279226  214454 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)

	I1104 11:18:20.290382  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1104 11:18:20.299498  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml

	I1104 11:18:20.301077  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	I1104 11:18:20.483445  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	W1104 11:18:20.609334  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:20.609417  214454 retry.go:31] will retry after 493.431263ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	W1104 11:18:20.609470  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:20.609506  214454 retry.go:31] will retry after 217.663252ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	W1104 11:18:20.609552  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:20.609583  214454 retry.go:31] will retry after 551.762371ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	W1104 11:18:20.723383  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:20.723463  214454 retry.go:31] will retry after 478.53666ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:20.827796  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	W1104 11:18:20.924459  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:20.924539  214454 retry.go:31] will retry after 258.11883ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:21.103967  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml

	I1104 11:18:21.162340  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1104 11:18:21.183017  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	W1104 11:18:21.200680  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:21.200774  214454 retry.go:31] will retry after 503.459148ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:21.202968  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	W1104 11:18:21.372841  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:21.372919  214454 retry.go:31] will retry after 626.143487ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	W1104 11:18:21.487613  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:21.487692  214454 retry.go:31] will retry after 471.894421ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	W1104 11:18:21.487741  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:21.487790  214454 retry.go:31] will retry after 561.860134ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:21.664294  214454 node_ready.go:53] error getting node "old-k8s-version-500235": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-500235": dial tcp 192.168.85.2:8443: connect: connection refused

	I1104 11:18:21.704652  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml

	W1104 11:18:21.812116  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:21.812206  214454 retry.go:31] will retry after 764.326749ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:21.960496  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I1104 11:18:22.000155  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1104 11:18:22.050431  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	W1104 11:18:22.102841  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:22.102944  214454 retry.go:31] will retry after 731.766991ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	W1104 11:18:22.289708  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:22.289814  214454 retry.go:31] will retry after 1.186806243s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	W1104 11:18:22.293218  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:22.293308  214454 retry.go:31] will retry after 944.838886ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:22.576758  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml

	W1104 11:18:22.678955  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:22.678985  214454 retry.go:31] will retry after 1.821588521s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:22.835320  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	W1104 11:18:22.943926  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:22.944019  214454 retry.go:31] will retry after 1.112899705s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:23.239268  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	W1104 11:18:23.356523  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:23.356565  214454 retry.go:31] will retry after 1.620031548s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:23.476806  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml

	W1104 11:18:23.569529  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:23.569569  214454 retry.go:31] will retry after 1.313392495s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:23.665343  214454 node_ready.go:53] error getting node "old-k8s-version-500235": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-500235": dial tcp 192.168.85.2:8443: connect: connection refused

	I1104 11:18:24.057844  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	W1104 11:18:24.153958  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:24.153988  214454 retry.go:31] will retry after 1.476052804s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:24.500810  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml

	W1104 11:18:24.616974  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:24.617004  214454 retry.go:31] will retry after 2.529429576s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:24.883099  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1104 11:18:24.977694  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	W1104 11:18:25.006849  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:25.006894  214454 retry.go:31] will retry after 2.072377738s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	W1104 11:18:25.112483  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:25.112514  214454 retry.go:31] will retry after 1.008697985s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:25.630758  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	W1104 11:18:25.752593  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:25.752629  214454 retry.go:31] will retry after 3.267944815s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:26.122279  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	I1104 11:18:26.164881  214454 node_ready.go:53] error getting node "old-k8s-version-500235": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-500235": dial tcp 192.168.85.2:8443: connect: connection refused

	W1104 11:18:26.226036  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:26.226077  214454 retry.go:31] will retry after 2.178495585s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:27.079440  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1104 11:18:27.146707  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml

	W1104 11:18:27.194147  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:27.194175  214454 retry.go:31] will retry after 3.47606665s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	W1104 11:18:27.344013  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:27.344041  214454 retry.go:31] will retry after 2.585494807s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:28.404772  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	W1104 11:18:28.648433  214454 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:28.648463  214454 retry.go:31] will retry after 2.850005377s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1

	stdout:

	stderr:

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	I1104 11:18:28.664983  214454 node_ready.go:53] error getting node "old-k8s-version-500235": Get "https://192.168.85.2:8443/api/v1/nodes/old-k8s-version-500235": dial tcp 192.168.85.2:8443: connect: connection refused

	I1104 11:18:29.021524  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I1104 11:18:29.930539  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml

	I1104 11:18:30.670474  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1104 11:18:31.499090  214454 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	I1104 11:18:39.330935  214454 node_ready.go:49] node "old-k8s-version-500235" has status "Ready":"True"

	I1104 11:18:39.330968  214454 node_ready.go:38] duration metric: took 19.667167779s for node "old-k8s-version-500235" to be "Ready" ...

	I1104 11:18:39.330979  214454 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1104 11:18:39.667186  214454 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-g4hz8" in "kube-system" namespace to be "Ready" ...

	I1104 11:18:40.136298  214454 pod_ready.go:93] pod "coredns-74ff55c5b-g4hz8" in "kube-system" namespace has status "Ready":"True"

	I1104 11:18:40.136376  214454 pod_ready.go:82] duration metric: took 469.104238ms for pod "coredns-74ff55c5b-g4hz8" in "kube-system" namespace to be "Ready" ...

	I1104 11:18:40.136406  214454 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-500235" in "kube-system" namespace to be "Ready" ...

	I1104 11:18:40.311514  214454 pod_ready.go:93] pod "etcd-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"True"

	I1104 11:18:40.311597  214454 pod_ready.go:82] duration metric: took 175.169423ms for pod "etcd-old-k8s-version-500235" in "kube-system" namespace to be "Ready" ...

	I1104 11:18:40.311633  214454 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-500235" in "kube-system" namespace to be "Ready" ...

	I1104 11:18:41.800267  214454 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (12.778702683s)

	I1104 11:18:41.800349  214454 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-500235"

	I1104 11:18:41.800431  214454 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (11.869868548s)

	I1104 11:18:41.800696  214454 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (11.130183611s)

	I1104 11:18:42.133871  214454 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (10.634658905s)

	I1104 11:18:42.136547  214454 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:

		minikube -p old-k8s-version-500235 addons enable metrics-server

	I1104 11:18:42.139196  214454 out.go:177] * Enabled addons: metrics-server, storage-provisioner, default-storageclass, dashboard

	I1104 11:18:42.141528  214454 addons.go:510] duration metric: took 22.772608925s for enable addons: enabled=[metrics-server storage-provisioner default-storageclass dashboard]

	I1104 11:18:42.318649  214454 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:18:44.321077  214454 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:18:46.818968  214454 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:18:49.318144  214454 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:18:50.318836  214454 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"True"

	I1104 11:18:50.318864  214454 pod_ready.go:82] duration metric: took 10.007188261s for pod "kube-apiserver-old-k8s-version-500235" in "kube-system" namespace to be "Ready" ...

	I1104 11:18:50.318883  214454 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-500235" in "kube-system" namespace to be "Ready" ...

	I1104 11:18:50.324549  214454 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"True"

	I1104 11:18:50.324577  214454 pod_ready.go:82] duration metric: took 5.684918ms for pod "kube-controller-manager-old-k8s-version-500235" in "kube-system" namespace to be "Ready" ...

	I1104 11:18:50.324590  214454 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-nh94t" in "kube-system" namespace to be "Ready" ...

	I1104 11:18:50.330566  214454 pod_ready.go:93] pod "kube-proxy-nh94t" in "kube-system" namespace has status "Ready":"True"

	I1104 11:18:50.330590  214454 pod_ready.go:82] duration metric: took 5.991228ms for pod "kube-proxy-nh94t" in "kube-system" namespace to be "Ready" ...

	I1104 11:18:50.330603  214454 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace to be "Ready" ...

	I1104 11:18:52.337716  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:18:54.338147  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:18:56.837128  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:18:58.858041  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:01.338584  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:03.341515  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:05.839061  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:08.338440  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:10.837191  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:12.838066  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:15.336198  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:17.838155  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:19.840701  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:22.337108  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:24.838098  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:27.342800  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:29.836344  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:31.837980  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:34.337166  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:36.337680  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:38.837406  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:40.838505  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:43.336698  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:45.341175  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:47.838056  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:49.843920  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:52.337598  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:54.837621  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:56.838649  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:19:59.352698  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:01.837531  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:04.337342  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:06.337419  214454 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:06.837283  214454 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace has status "Ready":"True"

	I1104 11:20:06.837312  214454 pod_ready.go:82] duration metric: took 1m16.506700701s for pod "kube-scheduler-old-k8s-version-500235" in "kube-system" namespace to be "Ready" ...

	I1104 11:20:06.837323  214454 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace to be "Ready" ...

	I1104 11:20:08.844171  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:11.343778  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:13.343935  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:15.844064  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:18.343834  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:20.344181  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:22.843242  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:24.844395  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:27.343687  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:29.847523  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:32.344061  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:34.843119  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:36.843696  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:38.844125  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:41.344359  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:43.852545  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:46.344081  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:48.843647  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:51.343461  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:53.344447  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:55.358425  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:57.843477  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:20:59.844631  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:01.844769  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:04.344718  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:06.844841  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:09.343972  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:11.344066  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:13.844019  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:15.846199  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:18.343866  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:20.366056  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:22.844240  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:25.343754  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:27.845079  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:30.343266  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:32.344557  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:34.844052  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:36.844311  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:38.845151  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:41.343564  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:43.845123  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:46.344348  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:48.843376  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:50.843674  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:52.844622  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:54.844881  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:57.344807  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:21:59.845004  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:02.351705  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:04.843357  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:06.843510  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:08.844260  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:10.854155  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:13.343973  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:15.845191  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:18.343807  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:20.945930  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:23.343416  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:25.344526  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:27.843315  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:29.844919  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:32.343198  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:34.344643  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:36.844059  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:38.845371  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:41.346079  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:43.843959  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:46.345037  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:48.844235  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:51.343423  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:53.343500  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:55.344199  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:22:57.844651  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:00.355018  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:02.844079  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:05.343295  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:07.343944  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:09.843386  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:11.843748  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:14.344030  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:16.344426  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:18.844121  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:20.844294  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:23.343108  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:25.344094  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:27.345594  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:29.844211  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:32.344732  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:34.843717  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:37.343085  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:39.343797  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:41.345191  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:43.842737  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:45.850443  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:48.342954  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:50.344311  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:52.843946  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:55.344056  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:23:57.844403  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:24:00.363135  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:24:02.846737  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:24:05.343957  214454 pod_ready.go:103] pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace has status "Ready":"False"

	I1104 11:24:06.845676  214454 pod_ready.go:82] duration metric: took 4m0.008337212s for pod "metrics-server-9975d5f86-qx7bx" in "kube-system" namespace to be "Ready" ...

	E1104 11:24:06.845704  214454 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded

	I1104 11:24:06.845713  214454 pod_ready.go:39] duration metric: took 5m27.514723687s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1104 11:24:06.845728  214454 api_server.go:52] waiting for apiserver process to appear ...

	I1104 11:24:06.845765  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}

	I1104 11:24:06.845828  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I1104 11:24:06.902021  214454 cri.go:89] found id: "3e8112e77fc159650cc821c6474494291af9e444ce6616d1a7b94efe6bbda6ab"

	I1104 11:24:06.902045  214454 cri.go:89] found id: "af8993ac19ddbf1c1b079010f12b22dd569c1d72a7170c14f6d752544c637c7c"

	I1104 11:24:06.902049  214454 cri.go:89] found id: ""

	I1104 11:24:06.902057  214454 logs.go:282] 2 containers: [3e8112e77fc159650cc821c6474494291af9e444ce6616d1a7b94efe6bbda6ab af8993ac19ddbf1c1b079010f12b22dd569c1d72a7170c14f6d752544c637c7c]

	I1104 11:24:06.902113  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:06.911191  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:06.915948  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}

	I1104 11:24:06.916022  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I1104 11:24:06.981248  214454 cri.go:89] found id: "264834df4b97845865803778632d50625eabbd66b2547ee289272493acd6170c"

	I1104 11:24:06.981270  214454 cri.go:89] found id: "5f9f6f643b47c2d78af3cabb479505c7d022b211d718f21f9722f20f23462507"

	I1104 11:24:06.981276  214454 cri.go:89] found id: ""

	I1104 11:24:06.981284  214454 logs.go:282] 2 containers: [264834df4b97845865803778632d50625eabbd66b2547ee289272493acd6170c 5f9f6f643b47c2d78af3cabb479505c7d022b211d718f21f9722f20f23462507]

	I1104 11:24:06.981339  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:06.985555  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:06.989303  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}

	I1104 11:24:06.989374  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I1104 11:24:07.050495  214454 cri.go:89] found id: "c4409d354d043fdd37e41a0d7a92c17c2c7e8581235a0a1e70b66f54f6ba08ad"

	I1104 11:24:07.050581  214454 cri.go:89] found id: "0eacea8f30c21c6e37db05c925c230cf081403ce010879dec3222a7e8391570a"

	I1104 11:24:07.050587  214454 cri.go:89] found id: ""

	I1104 11:24:07.050595  214454 logs.go:282] 2 containers: [c4409d354d043fdd37e41a0d7a92c17c2c7e8581235a0a1e70b66f54f6ba08ad 0eacea8f30c21c6e37db05c925c230cf081403ce010879dec3222a7e8391570a]

	I1104 11:24:07.050652  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:07.054588  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:07.057804  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}

	I1104 11:24:07.057873  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I1104 11:24:07.106375  214454 cri.go:89] found id: "a9495401d77549271b083bfe15401b0ef6a02bcb677de2b829aed6f2a0fd9267"

	I1104 11:24:07.106397  214454 cri.go:89] found id: "315609310246fb02d41baadc72115323d45bf3a159131f75ebbe409d29d740e3"

	I1104 11:24:07.106402  214454 cri.go:89] found id: ""

	I1104 11:24:07.106409  214454 logs.go:282] 2 containers: [a9495401d77549271b083bfe15401b0ef6a02bcb677de2b829aed6f2a0fd9267 315609310246fb02d41baadc72115323d45bf3a159131f75ebbe409d29d740e3]

	I1104 11:24:07.106462  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:07.110983  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:07.119175  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}

	I1104 11:24:07.119270  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I1104 11:24:07.184620  214454 cri.go:89] found id: "6f46935ab57f3ae4b043de0fbab5ec523c3e06cd43007d82aa078001cb601364"

	I1104 11:24:07.184642  214454 cri.go:89] found id: "e6255db4359d2fc972f43b37d6434c4571e71ddfe5bd608725f16a5f12803e0e"

	I1104 11:24:07.184647  214454 cri.go:89] found id: ""

	I1104 11:24:07.184655  214454 logs.go:282] 2 containers: [6f46935ab57f3ae4b043de0fbab5ec523c3e06cd43007d82aa078001cb601364 e6255db4359d2fc972f43b37d6434c4571e71ddfe5bd608725f16a5f12803e0e]

	I1104 11:24:07.184716  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:07.190557  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:07.194370  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}

	I1104 11:24:07.194440  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I1104 11:24:07.245187  214454 cri.go:89] found id: "35e17075a3193e117833a30cd41003ad02a46f6e354b8efeb4e40a703b3cf693"

	I1104 11:24:07.245206  214454 cri.go:89] found id: "5fc8337da03458cb82a696381c08decbec20e515a804b7d3039041c61f734ae0"

	I1104 11:24:07.245212  214454 cri.go:89] found id: ""

	I1104 11:24:07.245219  214454 logs.go:282] 2 containers: [35e17075a3193e117833a30cd41003ad02a46f6e354b8efeb4e40a703b3cf693 5fc8337da03458cb82a696381c08decbec20e515a804b7d3039041c61f734ae0]

	I1104 11:24:07.245308  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:07.250052  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:07.253883  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}

	I1104 11:24:07.253983  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I1104 11:24:07.305550  214454 cri.go:89] found id: "c97f229f531420939c1e1384e49e4b9908698c727ac4354a27b3e19689dcc0bb"

	I1104 11:24:07.305570  214454 cri.go:89] found id: "55de0e155bc4227fa1a7b7fbfa0a89934a702ea6e0398a4160b6f36cd9f30f1d"

	I1104 11:24:07.305575  214454 cri.go:89] found id: ""

	I1104 11:24:07.305583  214454 logs.go:282] 2 containers: [c97f229f531420939c1e1384e49e4b9908698c727ac4354a27b3e19689dcc0bb 55de0e155bc4227fa1a7b7fbfa0a89934a702ea6e0398a4160b6f36cd9f30f1d]

	I1104 11:24:07.305664  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:07.309698  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:07.313666  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}

	I1104 11:24:07.313762  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner

	I1104 11:24:07.363691  214454 cri.go:89] found id: "c50257d1470aacd8de9da23f4d89da365c3a14a55f18a6a61447c58175cffb43"

	I1104 11:24:07.363714  214454 cri.go:89] found id: "796847166109e53e702d6b306fa9c019e4fc48de5cc9c8ae2b0dc01439739800"

	I1104 11:24:07.363719  214454 cri.go:89] found id: ""

	I1104 11:24:07.363727  214454 logs.go:282] 2 containers: [c50257d1470aacd8de9da23f4d89da365c3a14a55f18a6a61447c58175cffb43 796847166109e53e702d6b306fa9c019e4fc48de5cc9c8ae2b0dc01439739800]

	I1104 11:24:07.363818  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:07.367765  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:07.371403  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}

	I1104 11:24:07.371504  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard

	I1104 11:24:07.414979  214454 cri.go:89] found id: "1796fcc40741bc21674b2d1e7ac63a200f8221893412d53b1a38dfee4597e57f"

	I1104 11:24:07.414998  214454 cri.go:89] found id: ""

	I1104 11:24:07.415006  214454 logs.go:282] 1 containers: [1796fcc40741bc21674b2d1e7ac63a200f8221893412d53b1a38dfee4597e57f]

	I1104 11:24:07.415094  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:07.419120  214454 logs.go:123] Gathering logs for etcd [5f9f6f643b47c2d78af3cabb479505c7d022b211d718f21f9722f20f23462507] ...

	I1104 11:24:07.419146  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f9f6f643b47c2d78af3cabb479505c7d022b211d718f21f9722f20f23462507"

	I1104 11:24:07.476721  214454 logs.go:123] Gathering logs for kube-proxy [6f46935ab57f3ae4b043de0fbab5ec523c3e06cd43007d82aa078001cb601364] ...

	I1104 11:24:07.476749  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f46935ab57f3ae4b043de0fbab5ec523c3e06cd43007d82aa078001cb601364"

	I1104 11:24:07.582799  214454 logs.go:123] Gathering logs for storage-provisioner [796847166109e53e702d6b306fa9c019e4fc48de5cc9c8ae2b0dc01439739800] ...

	I1104 11:24:07.582826  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 796847166109e53e702d6b306fa9c019e4fc48de5cc9c8ae2b0dc01439739800"

	I1104 11:24:07.639342  214454 logs.go:123] Gathering logs for container status ...

	I1104 11:24:07.639371  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1104 11:24:07.726618  214454 logs.go:123] Gathering logs for kindnet [c97f229f531420939c1e1384e49e4b9908698c727ac4354a27b3e19689dcc0bb] ...

	I1104 11:24:07.726650  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c97f229f531420939c1e1384e49e4b9908698c727ac4354a27b3e19689dcc0bb"

	I1104 11:24:07.788460  214454 logs.go:123] Gathering logs for kindnet [55de0e155bc4227fa1a7b7fbfa0a89934a702ea6e0398a4160b6f36cd9f30f1d] ...

	I1104 11:24:07.788492  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 55de0e155bc4227fa1a7b7fbfa0a89934a702ea6e0398a4160b6f36cd9f30f1d"

	I1104 11:24:07.840786  214454 logs.go:123] Gathering logs for kubelet ...

	I1104 11:24:07.840817  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W1104 11:24:07.906923  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.423612     660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:07.907196  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.424270     660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-l9dc6": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-l9dc6" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:07.907432  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.424755     660 reflector.go:138] object-"default"/"default-token-z9qg4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-z9qg4" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:07.907680  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.430997     660 reflector.go:138] object-"kube-system"/"metrics-server-token-xjxh8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-xjxh8" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:07.907913  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.431452     660 reflector.go:138] object-"kube-system"/"kindnet-token-f2jbd": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-f2jbd" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:07.908147  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.431965     660 reflector.go:138] object-"kube-system"/"coredns-token-lbpdj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-lbpdj" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:07.908375  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.432919     660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:07.908632  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.433260     660 reflector.go:138] object-"kube-system"/"kube-proxy-token-5q4pm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-5q4pm" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:07.920085  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:42 old-k8s-version-500235 kubelet[660]: E1104 11:18:42.297858     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	W1104 11:24:07.920313  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:42 old-k8s-version-500235 kubelet[660]: E1104 11:18:42.775321     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.923238  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:54 old-k8s-version-500235 kubelet[660]: E1104 11:18:54.479766     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	W1104 11:24:07.925356  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:05 old-k8s-version-500235 kubelet[660]: E1104 11:19:05.899280     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.925691  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:06 old-k8s-version-500235 kubelet[660]: E1104 11:19:06.904034     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.925877  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:07 old-k8s-version-500235 kubelet[660]: E1104 11:19:07.471254     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.926560  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:11 old-k8s-version-500235 kubelet[660]: E1104 11:19:11.841820     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.927000  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:12 old-k8s-version-500235 kubelet[660]: E1104 11:19:12.921990     660 pod_workers.go:191] Error syncing pod d3ca41cd-2794-4f2c-83f8-41d4258ac284 ("storage-provisioner_kube-system(d3ca41cd-2794-4f2c-83f8-41d4258ac284)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(d3ca41cd-2794-4f2c-83f8-41d4258ac284)"

	W1104 11:24:07.929782  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:20 old-k8s-version-500235 kubelet[660]: E1104 11:19:20.483478     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	W1104 11:24:07.930374  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:23 old-k8s-version-500235 kubelet[660]: E1104 11:19:23.967756     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.930905  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:31 old-k8s-version-500235 kubelet[660]: E1104 11:19:31.843037     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.931186  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:32 old-k8s-version-500235 kubelet[660]: E1104 11:19:32.471012     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.931373  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:45 old-k8s-version-500235 kubelet[660]: E1104 11:19:45.475690     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.932029  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:47 old-k8s-version-500235 kubelet[660]: E1104 11:19:47.055655     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.932383  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:51 old-k8s-version-500235 kubelet[660]: E1104 11:19:51.841700     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.932565  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:56 old-k8s-version-500235 kubelet[660]: E1104 11:19:56.470607     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.932892  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:02 old-k8s-version-500235 kubelet[660]: E1104 11:20:02.470249     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.935486  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:11 old-k8s-version-500235 kubelet[660]: E1104 11:20:11.483367     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	W1104 11:24:07.935829  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:15 old-k8s-version-500235 kubelet[660]: E1104 11:20:15.471716     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.936014  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:22 old-k8s-version-500235 kubelet[660]: E1104 11:20:22.470725     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.936622  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:31 old-k8s-version-500235 kubelet[660]: E1104 11:20:31.190004     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.937018  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:32 old-k8s-version-500235 kubelet[660]: E1104 11:20:32.194342     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.937204  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:37 old-k8s-version-500235 kubelet[660]: E1104 11:20:37.472542     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.937535  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:43 old-k8s-version-500235 kubelet[660]: E1104 11:20:43.470419     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.937743  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:51 old-k8s-version-500235 kubelet[660]: E1104 11:20:51.471084     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.939150  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:55 old-k8s-version-500235 kubelet[660]: E1104 11:20:55.470447     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.939366  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:04 old-k8s-version-500235 kubelet[660]: E1104 11:21:04.471097     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.939700  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:08 old-k8s-version-500235 kubelet[660]: E1104 11:21:08.470384     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.940021  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:16 old-k8s-version-500235 kubelet[660]: E1104 11:21:16.470760     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.940368  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:22 old-k8s-version-500235 kubelet[660]: E1104 11:21:22.470760     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.940555  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:31 old-k8s-version-500235 kubelet[660]: E1104 11:21:31.470642     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.940883  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:34 old-k8s-version-500235 kubelet[660]: E1104 11:21:34.470236     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.943359  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:43 old-k8s-version-500235 kubelet[660]: E1104 11:21:43.481904     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	W1104 11:24:07.943703  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:49 old-k8s-version-500235 kubelet[660]: E1104 11:21:49.470563     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.943889  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:55 old-k8s-version-500235 kubelet[660]: E1104 11:21:55.470818     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.944484  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:02 old-k8s-version-500235 kubelet[660]: E1104 11:22:02.453501     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.944671  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:09 old-k8s-version-500235 kubelet[660]: E1104 11:22:09.489119     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.944999  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:11 old-k8s-version-500235 kubelet[660]: E1104 11:22:11.842996     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.945185  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:23 old-k8s-version-500235 kubelet[660]: E1104 11:22:23.471189     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.945513  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:26 old-k8s-version-500235 kubelet[660]: E1104 11:22:26.470264     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.945697  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:36 old-k8s-version-500235 kubelet[660]: E1104 11:22:36.470686     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.946031  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:39 old-k8s-version-500235 kubelet[660]: E1104 11:22:39.471880     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.946217  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:48 old-k8s-version-500235 kubelet[660]: E1104 11:22:48.470674     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.946754  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:51 old-k8s-version-500235 kubelet[660]: E1104 11:22:51.470726     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.950691  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:02 old-k8s-version-500235 kubelet[660]: E1104 11:23:02.470754     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.951087  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:03 old-k8s-version-500235 kubelet[660]: E1104 11:23:03.474775     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.951304  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:13 old-k8s-version-500235 kubelet[660]: E1104 11:23:13.471159     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.951660  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:18 old-k8s-version-500235 kubelet[660]: E1104 11:23:18.470145     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.951878  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:24 old-k8s-version-500235 kubelet[660]: E1104 11:23:24.470904     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.952232  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:32 old-k8s-version-500235 kubelet[660]: E1104 11:23:32.470773     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.952449  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:38 old-k8s-version-500235 kubelet[660]: E1104 11:23:38.470775     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.952804  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:44 old-k8s-version-500235 kubelet[660]: E1104 11:23:44.470228     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.953014  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:49 old-k8s-version-500235 kubelet[660]: E1104 11:23:49.471350     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:07.953368  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:57 old-k8s-version-500235 kubelet[660]: E1104 11:23:57.471216     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:07.953576  214454 logs.go:138] Found kubelet problem: Nov 04 11:24:00 old-k8s-version-500235 kubelet[660]: E1104 11:24:00.472460     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	I1104 11:24:07.953600  214454 logs.go:123] Gathering logs for dmesg ...

	I1104 11:24:07.953630  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1104 11:24:07.970645  214454 logs.go:123] Gathering logs for describe nodes ...

	I1104 11:24:07.970670  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1104 11:24:08.248738  214454 logs.go:123] Gathering logs for etcd [264834df4b97845865803778632d50625eabbd66b2547ee289272493acd6170c] ...

	I1104 11:24:08.248819  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 264834df4b97845865803778632d50625eabbd66b2547ee289272493acd6170c"

	I1104 11:24:08.316346  214454 logs.go:123] Gathering logs for kube-controller-manager [5fc8337da03458cb82a696381c08decbec20e515a804b7d3039041c61f734ae0] ...

	I1104 11:24:08.316424  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5fc8337da03458cb82a696381c08decbec20e515a804b7d3039041c61f734ae0"

	I1104 11:24:08.454467  214454 logs.go:123] Gathering logs for containerd ...

	I1104 11:24:08.454574  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"

	I1104 11:24:08.533037  214454 logs.go:123] Gathering logs for coredns [c4409d354d043fdd37e41a0d7a92c17c2c7e8581235a0a1e70b66f54f6ba08ad] ...

	I1104 11:24:08.533075  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c4409d354d043fdd37e41a0d7a92c17c2c7e8581235a0a1e70b66f54f6ba08ad"

	I1104 11:24:08.586721  214454 logs.go:123] Gathering logs for kube-scheduler [a9495401d77549271b083bfe15401b0ef6a02bcb677de2b829aed6f2a0fd9267] ...

	I1104 11:24:08.586752  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a9495401d77549271b083bfe15401b0ef6a02bcb677de2b829aed6f2a0fd9267"

	I1104 11:24:08.627975  214454 logs.go:123] Gathering logs for kube-proxy [e6255db4359d2fc972f43b37d6434c4571e71ddfe5bd608725f16a5f12803e0e] ...

	I1104 11:24:08.628005  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e6255db4359d2fc972f43b37d6434c4571e71ddfe5bd608725f16a5f12803e0e"

	I1104 11:24:08.679357  214454 logs.go:123] Gathering logs for storage-provisioner [c50257d1470aacd8de9da23f4d89da365c3a14a55f18a6a61447c58175cffb43] ...

	I1104 11:24:08.679387  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c50257d1470aacd8de9da23f4d89da365c3a14a55f18a6a61447c58175cffb43"

	I1104 11:24:08.739355  214454 logs.go:123] Gathering logs for kubernetes-dashboard [1796fcc40741bc21674b2d1e7ac63a200f8221893412d53b1a38dfee4597e57f] ...

	I1104 11:24:08.739384  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1796fcc40741bc21674b2d1e7ac63a200f8221893412d53b1a38dfee4597e57f"

	I1104 11:24:08.806250  214454 logs.go:123] Gathering logs for kube-apiserver [3e8112e77fc159650cc821c6474494291af9e444ce6616d1a7b94efe6bbda6ab] ...

	I1104 11:24:08.806283  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3e8112e77fc159650cc821c6474494291af9e444ce6616d1a7b94efe6bbda6ab"

	I1104 11:24:08.903085  214454 logs.go:123] Gathering logs for kube-apiserver [af8993ac19ddbf1c1b079010f12b22dd569c1d72a7170c14f6d752544c637c7c] ...

	I1104 11:24:08.903160  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 af8993ac19ddbf1c1b079010f12b22dd569c1d72a7170c14f6d752544c637c7c"

	I1104 11:24:08.988266  214454 logs.go:123] Gathering logs for coredns [0eacea8f30c21c6e37db05c925c230cf081403ce010879dec3222a7e8391570a] ...

	I1104 11:24:08.988302  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0eacea8f30c21c6e37db05c925c230cf081403ce010879dec3222a7e8391570a"

	I1104 11:24:09.047018  214454 logs.go:123] Gathering logs for kube-scheduler [315609310246fb02d41baadc72115323d45bf3a159131f75ebbe409d29d740e3] ...

	I1104 11:24:09.047050  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 315609310246fb02d41baadc72115323d45bf3a159131f75ebbe409d29d740e3"

	I1104 11:24:09.106680  214454 logs.go:123] Gathering logs for kube-controller-manager [35e17075a3193e117833a30cd41003ad02a46f6e354b8efeb4e40a703b3cf693] ...

	I1104 11:24:09.106726  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 35e17075a3193e117833a30cd41003ad02a46f6e354b8efeb4e40a703b3cf693"

	I1104 11:24:09.207887  214454 out.go:358] Setting ErrFile to fd 2...

	I1104 11:24:09.207915  214454 out.go:392] TERM=,COLORTERM=, which probably does not support color

	W1104 11:24:09.208044  214454 out.go:270] X Problems detected in kubelet:

	X Problems detected in kubelet:

	W1104 11:24:09.208078  214454 out.go:270]   Nov 04 11:23:38 old-k8s-version-500235 kubelet[660]: E1104 11:23:38.470775     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	  Nov 04 11:23:38 old-k8s-version-500235 kubelet[660]: E1104 11:23:38.470775     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:09.208086  214454 out.go:270]   Nov 04 11:23:44 old-k8s-version-500235 kubelet[660]: E1104 11:23:44.470228     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	  Nov 04 11:23:44 old-k8s-version-500235 kubelet[660]: E1104 11:23:44.470228     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:09.208097  214454 out.go:270]   Nov 04 11:23:49 old-k8s-version-500235 kubelet[660]: E1104 11:23:49.471350     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	  Nov 04 11:23:49 old-k8s-version-500235 kubelet[660]: E1104 11:23:49.471350     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:09.208114  214454 out.go:270]   Nov 04 11:23:57 old-k8s-version-500235 kubelet[660]: E1104 11:23:57.471216     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	  Nov 04 11:23:57 old-k8s-version-500235 kubelet[660]: E1104 11:23:57.471216     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:09.208121  214454 out.go:270]   Nov 04 11:24:00 old-k8s-version-500235 kubelet[660]: E1104 11:24:00.472460     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	  Nov 04 11:24:00 old-k8s-version-500235 kubelet[660]: E1104 11:24:00.472460     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	I1104 11:24:09.208129  214454 out.go:358] Setting ErrFile to fd 2...

	I1104 11:24:09.208138  214454 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1104 11:24:19.209774  214454 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1104 11:24:19.221654  214454 api_server.go:72] duration metric: took 5m59.853054618s to wait for apiserver process to appear ...

	I1104 11:24:19.221677  214454 api_server.go:88] waiting for apiserver healthz status ...

	I1104 11:24:19.221711  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}

	I1104 11:24:19.221779  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I1104 11:24:19.258695  214454 cri.go:89] found id: "3e8112e77fc159650cc821c6474494291af9e444ce6616d1a7b94efe6bbda6ab"

	I1104 11:24:19.258717  214454 cri.go:89] found id: "af8993ac19ddbf1c1b079010f12b22dd569c1d72a7170c14f6d752544c637c7c"

	I1104 11:24:19.258721  214454 cri.go:89] found id: ""

	I1104 11:24:19.258728  214454 logs.go:282] 2 containers: [3e8112e77fc159650cc821c6474494291af9e444ce6616d1a7b94efe6bbda6ab af8993ac19ddbf1c1b079010f12b22dd569c1d72a7170c14f6d752544c637c7c]

	I1104 11:24:19.258784  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.262986  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.266379  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}

	I1104 11:24:19.266454  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I1104 11:24:19.306896  214454 cri.go:89] found id: "264834df4b97845865803778632d50625eabbd66b2547ee289272493acd6170c"

	I1104 11:24:19.306922  214454 cri.go:89] found id: "5f9f6f643b47c2d78af3cabb479505c7d022b211d718f21f9722f20f23462507"

	I1104 11:24:19.306928  214454 cri.go:89] found id: ""

	I1104 11:24:19.306934  214454 logs.go:282] 2 containers: [264834df4b97845865803778632d50625eabbd66b2547ee289272493acd6170c 5f9f6f643b47c2d78af3cabb479505c7d022b211d718f21f9722f20f23462507]

	I1104 11:24:19.306995  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.311636  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.314816  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}

	I1104 11:24:19.314880  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I1104 11:24:19.354839  214454 cri.go:89] found id: "c4409d354d043fdd37e41a0d7a92c17c2c7e8581235a0a1e70b66f54f6ba08ad"

	I1104 11:24:19.354871  214454 cri.go:89] found id: "0eacea8f30c21c6e37db05c925c230cf081403ce010879dec3222a7e8391570a"

	I1104 11:24:19.354877  214454 cri.go:89] found id: ""

	I1104 11:24:19.354884  214454 logs.go:282] 2 containers: [c4409d354d043fdd37e41a0d7a92c17c2c7e8581235a0a1e70b66f54f6ba08ad 0eacea8f30c21c6e37db05c925c230cf081403ce010879dec3222a7e8391570a]

	I1104 11:24:19.354940  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.358831  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.362201  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}

	I1104 11:24:19.362273  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I1104 11:24:19.403127  214454 cri.go:89] found id: "a9495401d77549271b083bfe15401b0ef6a02bcb677de2b829aed6f2a0fd9267"

	I1104 11:24:19.403147  214454 cri.go:89] found id: "315609310246fb02d41baadc72115323d45bf3a159131f75ebbe409d29d740e3"

	I1104 11:24:19.403152  214454 cri.go:89] found id: ""

	I1104 11:24:19.403159  214454 logs.go:282] 2 containers: [a9495401d77549271b083bfe15401b0ef6a02bcb677de2b829aed6f2a0fd9267 315609310246fb02d41baadc72115323d45bf3a159131f75ebbe409d29d740e3]

	I1104 11:24:19.403216  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.406895  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.410751  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}

	I1104 11:24:19.410825  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I1104 11:24:19.455106  214454 cri.go:89] found id: "6f46935ab57f3ae4b043de0fbab5ec523c3e06cd43007d82aa078001cb601364"

	I1104 11:24:19.455130  214454 cri.go:89] found id: "e6255db4359d2fc972f43b37d6434c4571e71ddfe5bd608725f16a5f12803e0e"

	I1104 11:24:19.455136  214454 cri.go:89] found id: ""

	I1104 11:24:19.455148  214454 logs.go:282] 2 containers: [6f46935ab57f3ae4b043de0fbab5ec523c3e06cd43007d82aa078001cb601364 e6255db4359d2fc972f43b37d6434c4571e71ddfe5bd608725f16a5f12803e0e]

	I1104 11:24:19.455205  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.461869  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.465580  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}

	I1104 11:24:19.465660  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I1104 11:24:19.521929  214454 cri.go:89] found id: "35e17075a3193e117833a30cd41003ad02a46f6e354b8efeb4e40a703b3cf693"

	I1104 11:24:19.521951  214454 cri.go:89] found id: "5fc8337da03458cb82a696381c08decbec20e515a804b7d3039041c61f734ae0"

	I1104 11:24:19.521956  214454 cri.go:89] found id: ""

	I1104 11:24:19.521962  214454 logs.go:282] 2 containers: [35e17075a3193e117833a30cd41003ad02a46f6e354b8efeb4e40a703b3cf693 5fc8337da03458cb82a696381c08decbec20e515a804b7d3039041c61f734ae0]

	I1104 11:24:19.522080  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.526037  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.529888  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}

	I1104 11:24:19.529954  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I1104 11:24:19.596049  214454 cri.go:89] found id: "c97f229f531420939c1e1384e49e4b9908698c727ac4354a27b3e19689dcc0bb"

	I1104 11:24:19.596069  214454 cri.go:89] found id: "55de0e155bc4227fa1a7b7fbfa0a89934a702ea6e0398a4160b6f36cd9f30f1d"

	I1104 11:24:19.596073  214454 cri.go:89] found id: ""

	I1104 11:24:19.596083  214454 logs.go:282] 2 containers: [c97f229f531420939c1e1384e49e4b9908698c727ac4354a27b3e19689dcc0bb 55de0e155bc4227fa1a7b7fbfa0a89934a702ea6e0398a4160b6f36cd9f30f1d]

	I1104 11:24:19.596137  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.603262  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.608309  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}

	I1104 11:24:19.608396  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard

	I1104 11:24:19.680057  214454 cri.go:89] found id: "1796fcc40741bc21674b2d1e7ac63a200f8221893412d53b1a38dfee4597e57f"

	I1104 11:24:19.680078  214454 cri.go:89] found id: ""

	I1104 11:24:19.680086  214454 logs.go:282] 1 containers: [1796fcc40741bc21674b2d1e7ac63a200f8221893412d53b1a38dfee4597e57f]

	I1104 11:24:19.680142  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.690311  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}

	I1104 11:24:19.690382  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner

	I1104 11:24:19.746226  214454 cri.go:89] found id: "c50257d1470aacd8de9da23f4d89da365c3a14a55f18a6a61447c58175cffb43"

	I1104 11:24:19.746245  214454 cri.go:89] found id: "796847166109e53e702d6b306fa9c019e4fc48de5cc9c8ae2b0dc01439739800"

	I1104 11:24:19.746250  214454 cri.go:89] found id: ""

	I1104 11:24:19.746257  214454 logs.go:282] 2 containers: [c50257d1470aacd8de9da23f4d89da365c3a14a55f18a6a61447c58175cffb43 796847166109e53e702d6b306fa9c019e4fc48de5cc9c8ae2b0dc01439739800]

	I1104 11:24:19.746310  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.750587  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.754575  214454 logs.go:123] Gathering logs for kube-scheduler [315609310246fb02d41baadc72115323d45bf3a159131f75ebbe409d29d740e3] ...

	I1104 11:24:19.754656  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 315609310246fb02d41baadc72115323d45bf3a159131f75ebbe409d29d740e3"

	I1104 11:24:19.810258  214454 logs.go:123] Gathering logs for kube-controller-manager [5fc8337da03458cb82a696381c08decbec20e515a804b7d3039041c61f734ae0] ...

	I1104 11:24:19.810397  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5fc8337da03458cb82a696381c08decbec20e515a804b7d3039041c61f734ae0"

	I1104 11:24:19.957537  214454 logs.go:123] Gathering logs for container status ...

	I1104 11:24:19.957575  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1104 11:24:20.041252  214454 logs.go:123] Gathering logs for kubelet ...

	I1104 11:24:20.041353  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W1104 11:24:20.175092  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.423612     660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.175341  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.424270     660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-l9dc6": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-l9dc6" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.175556  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.424755     660 reflector.go:138] object-"default"/"default-token-z9qg4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-z9qg4" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.175775  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.430997     660 reflector.go:138] object-"kube-system"/"metrics-server-token-xjxh8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-xjxh8" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.175992  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.431452     660 reflector.go:138] object-"kube-system"/"kindnet-token-f2jbd": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-f2jbd" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.186107  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.431965     660 reflector.go:138] object-"kube-system"/"coredns-token-lbpdj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-lbpdj" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.186368  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.432919     660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.186635  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.433260     660 reflector.go:138] object-"kube-system"/"kube-proxy-token-5q4pm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-5q4pm" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.208682  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:42 old-k8s-version-500235 kubelet[660]: E1104 11:18:42.297858     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	W1104 11:24:20.208945  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:42 old-k8s-version-500235 kubelet[660]: E1104 11:18:42.775321     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.223786  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:54 old-k8s-version-500235 kubelet[660]: E1104 11:18:54.479766     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	W1104 11:24:20.228692  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:05 old-k8s-version-500235 kubelet[660]: E1104 11:19:05.899280     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.229046  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:06 old-k8s-version-500235 kubelet[660]: E1104 11:19:06.904034     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.229254  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:07 old-k8s-version-500235 kubelet[660]: E1104 11:19:07.471254     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.229929  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:11 old-k8s-version-500235 kubelet[660]: E1104 11:19:11.841820     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.230368  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:12 old-k8s-version-500235 kubelet[660]: E1104 11:19:12.921990     660 pod_workers.go:191] Error syncing pod d3ca41cd-2794-4f2c-83f8-41d4258ac284 ("storage-provisioner_kube-system(d3ca41cd-2794-4f2c-83f8-41d4258ac284)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(d3ca41cd-2794-4f2c-83f8-41d4258ac284)"

	W1104 11:24:20.241478  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:20 old-k8s-version-500235 kubelet[660]: E1104 11:19:20.483478     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	W1104 11:24:20.242095  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:23 old-k8s-version-500235 kubelet[660]: E1104 11:19:23.967756     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.250709  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:31 old-k8s-version-500235 kubelet[660]: E1104 11:19:31.843037     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.250919  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:32 old-k8s-version-500235 kubelet[660]: E1104 11:19:32.471012     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.251102  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:45 old-k8s-version-500235 kubelet[660]: E1104 11:19:45.475690     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.251689  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:47 old-k8s-version-500235 kubelet[660]: E1104 11:19:47.055655     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.252018  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:51 old-k8s-version-500235 kubelet[660]: E1104 11:19:51.841700     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.252200  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:56 old-k8s-version-500235 kubelet[660]: E1104 11:19:56.470607     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.252541  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:02 old-k8s-version-500235 kubelet[660]: E1104 11:20:02.470249     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.262114  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:11 old-k8s-version-500235 kubelet[660]: E1104 11:20:11.483367     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	W1104 11:24:20.262463  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:15 old-k8s-version-500235 kubelet[660]: E1104 11:20:15.471716     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.263890  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:22 old-k8s-version-500235 kubelet[660]: E1104 11:20:22.470725     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.265328  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:31 old-k8s-version-500235 kubelet[660]: E1104 11:20:31.190004     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.267424  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:32 old-k8s-version-500235 kubelet[660]: E1104 11:20:32.194342     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.267628  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:37 old-k8s-version-500235 kubelet[660]: E1104 11:20:37.472542     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.267962  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:43 old-k8s-version-500235 kubelet[660]: E1104 11:20:43.470419     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.268156  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:51 old-k8s-version-500235 kubelet[660]: E1104 11:20:51.471084     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.269596  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:55 old-k8s-version-500235 kubelet[660]: E1104 11:20:55.470447     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.269796  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:04 old-k8s-version-500235 kubelet[660]: E1104 11:21:04.471097     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.270396  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:08 old-k8s-version-500235 kubelet[660]: E1104 11:21:08.470384     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.270730  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:16 old-k8s-version-500235 kubelet[660]: E1104 11:21:16.470760     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.272229  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:22 old-k8s-version-500235 kubelet[660]: E1104 11:21:22.470760     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.272442  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:31 old-k8s-version-500235 kubelet[660]: E1104 11:21:31.470642     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.272768  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:34 old-k8s-version-500235 kubelet[660]: E1104 11:21:34.470236     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.280285  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:43 old-k8s-version-500235 kubelet[660]: E1104 11:21:43.481904     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	W1104 11:24:20.283000  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:49 old-k8s-version-500235 kubelet[660]: E1104 11:21:49.470563     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.284335  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:55 old-k8s-version-500235 kubelet[660]: E1104 11:21:55.470818     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.286921  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:02 old-k8s-version-500235 kubelet[660]: E1104 11:22:02.453501     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.287126  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:09 old-k8s-version-500235 kubelet[660]: E1104 11:22:09.489119     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.287458  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:11 old-k8s-version-500235 kubelet[660]: E1104 11:22:11.842996     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.287643  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:23 old-k8s-version-500235 kubelet[660]: E1104 11:22:23.471189     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.287983  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:26 old-k8s-version-500235 kubelet[660]: E1104 11:22:26.470264     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.288167  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:36 old-k8s-version-500235 kubelet[660]: E1104 11:22:36.470686     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.288502  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:39 old-k8s-version-500235 kubelet[660]: E1104 11:22:39.471880     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.288685  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:48 old-k8s-version-500235 kubelet[660]: E1104 11:22:48.470674     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.289013  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:51 old-k8s-version-500235 kubelet[660]: E1104 11:22:51.470726     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.289198  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:02 old-k8s-version-500235 kubelet[660]: E1104 11:23:02.470754     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.289525  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:03 old-k8s-version-500235 kubelet[660]: E1104 11:23:03.474775     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.289709  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:13 old-k8s-version-500235 kubelet[660]: E1104 11:23:13.471159     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.290041  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:18 old-k8s-version-500235 kubelet[660]: E1104 11:23:18.470145     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.291203  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:24 old-k8s-version-500235 kubelet[660]: E1104 11:23:24.470904     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.293634  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:32 old-k8s-version-500235 kubelet[660]: E1104 11:23:32.470773     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.295399  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:38 old-k8s-version-500235 kubelet[660]: E1104 11:23:38.470775     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.296563  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:44 old-k8s-version-500235 kubelet[660]: E1104 11:23:44.470228     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.296766  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:49 old-k8s-version-500235 kubelet[660]: E1104 11:23:49.471350     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.297095  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:57 old-k8s-version-500235 kubelet[660]: E1104 11:23:57.471216     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.297285  214454 logs.go:138] Found kubelet problem: Nov 04 11:24:00 old-k8s-version-500235 kubelet[660]: E1104 11:24:00.472460     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.297469  214454 logs.go:138] Found kubelet problem: Nov 04 11:24:11 old-k8s-version-500235 kubelet[660]: E1104 11:24:11.473454     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.297799  214454 logs.go:138] Found kubelet problem: Nov 04 11:24:12 old-k8s-version-500235 kubelet[660]: E1104 11:24:12.470610     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	I1104 11:24:20.297810  214454 logs.go:123] Gathering logs for kube-apiserver [af8993ac19ddbf1c1b079010f12b22dd569c1d72a7170c14f6d752544c637c7c] ...

	I1104 11:24:20.297824  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 af8993ac19ddbf1c1b079010f12b22dd569c1d72a7170c14f6d752544c637c7c"

	I1104 11:24:20.404326  214454 logs.go:123] Gathering logs for etcd [264834df4b97845865803778632d50625eabbd66b2547ee289272493acd6170c] ...

	I1104 11:24:20.404377  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 264834df4b97845865803778632d50625eabbd66b2547ee289272493acd6170c"

	I1104 11:24:20.488836  214454 logs.go:123] Gathering logs for kube-scheduler [a9495401d77549271b083bfe15401b0ef6a02bcb677de2b829aed6f2a0fd9267] ...

	I1104 11:24:20.488872  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a9495401d77549271b083bfe15401b0ef6a02bcb677de2b829aed6f2a0fd9267"

	I1104 11:24:20.557329  214454 logs.go:123] Gathering logs for kindnet [55de0e155bc4227fa1a7b7fbfa0a89934a702ea6e0398a4160b6f36cd9f30f1d] ...

	I1104 11:24:20.557355  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 55de0e155bc4227fa1a7b7fbfa0a89934a702ea6e0398a4160b6f36cd9f30f1d"

	I1104 11:24:20.669198  214454 logs.go:123] Gathering logs for kubernetes-dashboard [1796fcc40741bc21674b2d1e7ac63a200f8221893412d53b1a38dfee4597e57f] ...

	I1104 11:24:20.669227  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1796fcc40741bc21674b2d1e7ac63a200f8221893412d53b1a38dfee4597e57f"

	I1104 11:24:20.792876  214454 logs.go:123] Gathering logs for storage-provisioner [796847166109e53e702d6b306fa9c019e4fc48de5cc9c8ae2b0dc01439739800] ...

	I1104 11:24:20.792908  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 796847166109e53e702d6b306fa9c019e4fc48de5cc9c8ae2b0dc01439739800"

	I1104 11:24:20.928326  214454 logs.go:123] Gathering logs for dmesg ...

	I1104 11:24:20.928363  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1104 11:24:20.986646  214454 logs.go:123] Gathering logs for describe nodes ...

	I1104 11:24:20.986728  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1104 11:24:21.261313  214454 logs.go:123] Gathering logs for etcd [5f9f6f643b47c2d78af3cabb479505c7d022b211d718f21f9722f20f23462507] ...

	I1104 11:24:21.261413  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f9f6f643b47c2d78af3cabb479505c7d022b211d718f21f9722f20f23462507"

	I1104 11:24:21.355008  214454 logs.go:123] Gathering logs for kube-controller-manager [35e17075a3193e117833a30cd41003ad02a46f6e354b8efeb4e40a703b3cf693] ...

	I1104 11:24:21.355041  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 35e17075a3193e117833a30cd41003ad02a46f6e354b8efeb4e40a703b3cf693"

	I1104 11:24:21.419460  214454 logs.go:123] Gathering logs for kube-apiserver [3e8112e77fc159650cc821c6474494291af9e444ce6616d1a7b94efe6bbda6ab] ...

	I1104 11:24:21.419494  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3e8112e77fc159650cc821c6474494291af9e444ce6616d1a7b94efe6bbda6ab"

	I1104 11:24:21.522241  214454 logs.go:123] Gathering logs for kube-proxy [e6255db4359d2fc972f43b37d6434c4571e71ddfe5bd608725f16a5f12803e0e] ...

	I1104 11:24:21.522278  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e6255db4359d2fc972f43b37d6434c4571e71ddfe5bd608725f16a5f12803e0e"

	I1104 11:24:21.573603  214454 logs.go:123] Gathering logs for storage-provisioner [c50257d1470aacd8de9da23f4d89da365c3a14a55f18a6a61447c58175cffb43] ...

	I1104 11:24:21.573679  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c50257d1470aacd8de9da23f4d89da365c3a14a55f18a6a61447c58175cffb43"

	I1104 11:24:21.626213  214454 logs.go:123] Gathering logs for containerd ...

	I1104 11:24:21.626285  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"

	I1104 11:24:21.693384  214454 logs.go:123] Gathering logs for coredns [c4409d354d043fdd37e41a0d7a92c17c2c7e8581235a0a1e70b66f54f6ba08ad] ...

	I1104 11:24:21.693422  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c4409d354d043fdd37e41a0d7a92c17c2c7e8581235a0a1e70b66f54f6ba08ad"

	I1104 11:24:21.750219  214454 logs.go:123] Gathering logs for coredns [0eacea8f30c21c6e37db05c925c230cf081403ce010879dec3222a7e8391570a] ...

	I1104 11:24:21.750252  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0eacea8f30c21c6e37db05c925c230cf081403ce010879dec3222a7e8391570a"

	I1104 11:24:21.811584  214454 logs.go:123] Gathering logs for kube-proxy [6f46935ab57f3ae4b043de0fbab5ec523c3e06cd43007d82aa078001cb601364] ...

	I1104 11:24:21.811615  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f46935ab57f3ae4b043de0fbab5ec523c3e06cd43007d82aa078001cb601364"

	I1104 11:24:21.860823  214454 logs.go:123] Gathering logs for kindnet [c97f229f531420939c1e1384e49e4b9908698c727ac4354a27b3e19689dcc0bb] ...

	I1104 11:24:21.860901  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c97f229f531420939c1e1384e49e4b9908698c727ac4354a27b3e19689dcc0bb"

	I1104 11:24:21.928221  214454 out.go:358] Setting ErrFile to fd 2...

	I1104 11:24:21.928247  214454 out.go:392] TERM=,COLORTERM=, which probably does not support color

	W1104 11:24:21.928369  214454 out.go:270] X Problems detected in kubelet:

	X Problems detected in kubelet:

	W1104 11:24:21.928387  214454 out.go:270]   Nov 04 11:23:49 old-k8s-version-500235 kubelet[660]: E1104 11:23:49.471350     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	  Nov 04 11:23:49 old-k8s-version-500235 kubelet[660]: E1104 11:23:49.471350     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:21.928396  214454 out.go:270]   Nov 04 11:23:57 old-k8s-version-500235 kubelet[660]: E1104 11:23:57.471216     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	  Nov 04 11:23:57 old-k8s-version-500235 kubelet[660]: E1104 11:23:57.471216     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:21.928427  214454 out.go:270]   Nov 04 11:24:00 old-k8s-version-500235 kubelet[660]: E1104 11:24:00.472460     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	  Nov 04 11:24:00 old-k8s-version-500235 kubelet[660]: E1104 11:24:00.472460     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:21.928437  214454 out.go:270]   Nov 04 11:24:11 old-k8s-version-500235 kubelet[660]: E1104 11:24:11.473454     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	  Nov 04 11:24:11 old-k8s-version-500235 kubelet[660]: E1104 11:24:11.473454     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:21.928447  214454 out.go:270]   Nov 04 11:24:12 old-k8s-version-500235 kubelet[660]: E1104 11:24:12.470610     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	  Nov 04 11:24:12 old-k8s-version-500235 kubelet[660]: E1104 11:24:12.470610     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	I1104 11:24:21.928453  214454 out.go:358] Setting ErrFile to fd 2...

	I1104 11:24:21.928460  214454 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1104 11:24:31.929882  214454 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...

	I1104 11:24:31.943655  214454 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:

	ok

	I1104 11:24:31.947067  214454 out.go:201] 

	W1104 11:24:31.950694  214454 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0

	X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0

	W1104 11:24:31.950914  214454 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge

	* Suggestion: Control Plane could not update, try minikube delete --all --purge

	W1104 11:24:31.950982  214454 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417

	* Related issue: https://github.com/kubernetes/minikube/issues/11417

	W1104 11:24:31.951015  214454 out.go:270] * 

	* 

	W1104 11:24:31.952131  214454 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1104 11:24:31.954366  214454 out.go:201] 

** /stderr **

start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-500235 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect old-k8s-version-500235

helpers_test.go:235: (dbg) docker inspect old-k8s-version-500235:

-- stdout --

	[

	    {

	        "Id": "b9cbd45fc274d0f01d953ae6b5a27584d9daf67913d93f2246556070735c889e",

	        "Created": "2024-11-04T11:15:34.346827447Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 214643,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2024-11-04T11:18:11.563294521Z",

	            "FinishedAt": "2024-11-04T11:18:10.667075332Z"

	        },

	        "Image": "sha256:b9c385cbd7184c9dd77d4bc379a996635e559e337cc53655e2d39219017c804c",

	        "ResolvConfPath": "/var/lib/docker/containers/b9cbd45fc274d0f01d953ae6b5a27584d9daf67913d93f2246556070735c889e/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/b9cbd45fc274d0f01d953ae6b5a27584d9daf67913d93f2246556070735c889e/hostname",

	        "HostsPath": "/var/lib/docker/containers/b9cbd45fc274d0f01d953ae6b5a27584d9daf67913d93f2246556070735c889e/hosts",

	        "LogPath": "/var/lib/docker/containers/b9cbd45fc274d0f01d953ae6b5a27584d9daf67913d93f2246556070735c889e/b9cbd45fc274d0f01d953ae6b5a27584d9daf67913d93f2246556070735c889e-json.log",

	        "Name": "/old-k8s-version-500235",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "unconfined",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "old-k8s-version-500235:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "old-k8s-version-500235",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 2306867200,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": [],

	            "BlkioDeviceWriteBps": [],

	            "BlkioDeviceReadIOps": [],

	            "BlkioDeviceWriteIOps": [],

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "MemoryReservation": 0,

	            "MemorySwap": 4613734400,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": [],

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/c24d93e31c622f4c1085571dc94fe171733270fc06f7fa696ce5ef3150a8dd17-init/diff:/var/lib/docker/overlay2/311acf0662561a66cc330966597db438400b703fe41a25d44cdc1ebace168962/diff",

	                "MergedDir": "/var/lib/docker/overlay2/c24d93e31c622f4c1085571dc94fe171733270fc06f7fa696ce5ef3150a8dd17/merged",

	                "UpperDir": "/var/lib/docker/overlay2/c24d93e31c622f4c1085571dc94fe171733270fc06f7fa696ce5ef3150a8dd17/diff",

	                "WorkDir": "/var/lib/docker/overlay2/c24d93e31c622f4c1085571dc94fe171733270fc06f7fa696ce5ef3150a8dd17/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "volume",

	                "Name": "old-k8s-version-500235",

	                "Source": "/var/lib/docker/volumes/old-k8s-version-500235/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            },

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            }

	        ],

	        "Config": {

	            "Hostname": "old-k8s-version-500235",

	            "Domainname": "",

	            "User": "",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4",

	            "Volumes": null,

	            "WorkingDir": "/",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "old-k8s-version-500235",

	                "name.minikube.sigs.k8s.io": "old-k8s-version-500235",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "e5daa001e57bc5153ac375bc9713f795031c8eef42ff9b10e57925132635d96a",

	            "SandboxKey": "/var/run/docker/netns/e5daa001e57b",

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33063"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33064"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33067"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33065"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33066"

	                    }

	                ]

	            },

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "old-k8s-version-500235": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.85.2"

	                    },

	                    "Links": null,

	                    "Aliases": null,

	                    "MacAddress": "02:42:c0:a8:55:02",

	                    "DriverOpts": null,

	                    "NetworkID": "520a3cd778c60ffa5b1bd83cebc2e99789ac25d89df656974c056a09cdb35315",

	                    "EndpointID": "94f0743af6432df45f374ce41637d7d5e8ee824e6161c6f23aa0db7d15c0a297",

	                    "Gateway": "192.168.85.1",

	                    "IPAddress": "192.168.85.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "DNSNames": [

	                        "old-k8s-version-500235",

	                        "b9cbd45fc274"

	                    ]

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-500235 -n old-k8s-version-500235

helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p old-k8s-version-500235 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-500235 logs -n 25: (2.685009513s)

helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs: 

-- stdout --

	==> Audit <==

	|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|

	| Command |                          Args                          |           Profile            |  User   | Version |     Start Time      |      End Time       |

	|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|

	| start   | -p cert-expiration-488228                              | cert-expiration-488228       | jenkins | v1.34.0 | 04 Nov 24 11:14 UTC | 04 Nov 24 11:14 UTC |

	|         | --memory=2048                                          |                              |         |         |                     |                     |

	|         | --cert-expiration=3m                                   |                              |         |         |                     |                     |

	|         | --driver=docker                                        |                              |         |         |                     |                     |

	|         | --container-runtime=containerd                         |                              |         |         |                     |                     |

	| ssh     | force-systemd-env-346323                               | force-systemd-env-346323     | jenkins | v1.34.0 | 04 Nov 24 11:14 UTC | 04 Nov 24 11:14 UTC |

	|         | ssh cat                                                |                              |         |         |                     |                     |

	|         | /etc/containerd/config.toml                            |                              |         |         |                     |                     |

	| delete  | -p force-systemd-env-346323                            | force-systemd-env-346323     | jenkins | v1.34.0 | 04 Nov 24 11:14 UTC | 04 Nov 24 11:14 UTC |

	| start   | -p cert-options-198698                                 | cert-options-198698          | jenkins | v1.34.0 | 04 Nov 24 11:14 UTC | 04 Nov 24 11:15 UTC |

	|         | --memory=2048                                          |                              |         |         |                     |                     |

	|         | --apiserver-ips=127.0.0.1                              |                              |         |         |                     |                     |

	|         | --apiserver-ips=192.168.15.15                          |                              |         |         |                     |                     |

	|         | --apiserver-names=localhost                            |                              |         |         |                     |                     |

	|         | --apiserver-names=www.google.com                       |                              |         |         |                     |                     |

	|         | --apiserver-port=8555                                  |                              |         |         |                     |                     |

	|         | --driver=docker                                        |                              |         |         |                     |                     |

	|         | --container-runtime=containerd                         |                              |         |         |                     |                     |

	| ssh     | cert-options-198698 ssh                                | cert-options-198698          | jenkins | v1.34.0 | 04 Nov 24 11:15 UTC | 04 Nov 24 11:15 UTC |

	|         | openssl x509 -text -noout -in                          |                              |         |         |                     |                     |

	|         | /var/lib/minikube/certs/apiserver.crt                  |                              |         |         |                     |                     |

	| ssh     | -p cert-options-198698 -- sudo                         | cert-options-198698          | jenkins | v1.34.0 | 04 Nov 24 11:15 UTC | 04 Nov 24 11:15 UTC |

	|         | cat /etc/kubernetes/admin.conf                         |                              |         |         |                     |                     |

	| delete  | -p cert-options-198698                                 | cert-options-198698          | jenkins | v1.34.0 | 04 Nov 24 11:15 UTC | 04 Nov 24 11:15 UTC |

	| start   | -p old-k8s-version-500235                              | old-k8s-version-500235       | jenkins | v1.34.0 | 04 Nov 24 11:15 UTC | 04 Nov 24 11:17 UTC |

	|         | --memory=2200                                          |                              |         |         |                     |                     |

	|         | --alsologtostderr --wait=true                          |                              |         |         |                     |                     |

	|         | --kvm-network=default                                  |                              |         |         |                     |                     |

	|         | --kvm-qemu-uri=qemu:///system                          |                              |         |         |                     |                     |

	|         | --disable-driver-mounts                                |                              |         |         |                     |                     |

	|         | --keep-context=false                                   |                              |         |         |                     |                     |

	|         | --driver=docker                                        |                              |         |         |                     |                     |

	|         | --container-runtime=containerd                         |                              |         |         |                     |                     |

	|         | --kubernetes-version=v1.20.0                           |                              |         |         |                     |                     |

	| start   | -p cert-expiration-488228                              | cert-expiration-488228       | jenkins | v1.34.0 | 04 Nov 24 11:17 UTC | 04 Nov 24 11:18 UTC |

	|         | --memory=2048                                          |                              |         |         |                     |                     |

	|         | --cert-expiration=8760h                                |                              |         |         |                     |                     |

	|         | --driver=docker                                        |                              |         |         |                     |                     |

	|         | --container-runtime=containerd                         |                              |         |         |                     |                     |

	| addons  | enable metrics-server -p old-k8s-version-500235        | old-k8s-version-500235       | jenkins | v1.34.0 | 04 Nov 24 11:17 UTC | 04 Nov 24 11:17 UTC |

	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                              |         |         |                     |                     |

	|         | --registries=MetricsServer=fake.domain                 |                              |         |         |                     |                     |

	| stop    | -p old-k8s-version-500235                              | old-k8s-version-500235       | jenkins | v1.34.0 | 04 Nov 24 11:17 UTC | 04 Nov 24 11:18 UTC |

	|         | --alsologtostderr -v=3                                 |                              |         |         |                     |                     |

	| delete  | -p cert-expiration-488228                              | cert-expiration-488228       | jenkins | v1.34.0 | 04 Nov 24 11:18 UTC | 04 Nov 24 11:18 UTC |

	| start   | -p                                                     | default-k8s-diff-port-075721 | jenkins | v1.34.0 | 04 Nov 24 11:18 UTC | 04 Nov 24 11:19 UTC |

	|         | default-k8s-diff-port-075721                           |                              |         |         |                     |                     |

	|         | --memory=2200                                          |                              |         |         |                     |                     |

	|         | --alsologtostderr --wait=true                          |                              |         |         |                     |                     |

	|         | --apiserver-port=8444                                  |                              |         |         |                     |                     |

	|         | --driver=docker                                        |                              |         |         |                     |                     |

	|         | --container-runtime=containerd                         |                              |         |         |                     |                     |

	|         | --kubernetes-version=v1.31.2                           |                              |         |         |                     |                     |

	| addons  | enable dashboard -p old-k8s-version-500235             | old-k8s-version-500235       | jenkins | v1.34.0 | 04 Nov 24 11:18 UTC | 04 Nov 24 11:18 UTC |

	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                              |         |         |                     |                     |

	| start   | -p old-k8s-version-500235                              | old-k8s-version-500235       | jenkins | v1.34.0 | 04 Nov 24 11:18 UTC |                     |

	|         | --memory=2200                                          |                              |         |         |                     |                     |

	|         | --alsologtostderr --wait=true                          |                              |         |         |                     |                     |

	|         | --kvm-network=default                                  |                              |         |         |                     |                     |

	|         | --kvm-qemu-uri=qemu:///system                          |                              |         |         |                     |                     |

	|         | --disable-driver-mounts                                |                              |         |         |                     |                     |

	|         | --keep-context=false                                   |                              |         |         |                     |                     |

	|         | --driver=docker                                        |                              |         |         |                     |                     |

	|         | --container-runtime=containerd                         |                              |         |         |                     |                     |

	|         | --kubernetes-version=v1.20.0                           |                              |         |         |                     |                     |

	| addons  | enable metrics-server -p default-k8s-diff-port-075721  | default-k8s-diff-port-075721 | jenkins | v1.34.0 | 04 Nov 24 11:19 UTC | 04 Nov 24 11:19 UTC |

	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                              |         |         |                     |                     |

	|         | --registries=MetricsServer=fake.domain                 |                              |         |         |                     |                     |

	| stop    | -p                                                     | default-k8s-diff-port-075721 | jenkins | v1.34.0 | 04 Nov 24 11:19 UTC | 04 Nov 24 11:19 UTC |

	|         | default-k8s-diff-port-075721                           |                              |         |         |                     |                     |

	|         | --alsologtostderr -v=3                                 |                              |         |         |                     |                     |

	| addons  | enable dashboard -p default-k8s-diff-port-075721       | default-k8s-diff-port-075721 | jenkins | v1.34.0 | 04 Nov 24 11:19 UTC | 04 Nov 24 11:19 UTC |

	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                              |         |         |                     |                     |

	| start   | -p                                                     | default-k8s-diff-port-075721 | jenkins | v1.34.0 | 04 Nov 24 11:19 UTC | 04 Nov 24 11:23 UTC |

	|         | default-k8s-diff-port-075721                           |                              |         |         |                     |                     |

	|         | --memory=2200                                          |                              |         |         |                     |                     |

	|         | --alsologtostderr --wait=true                          |                              |         |         |                     |                     |

	|         | --apiserver-port=8444                                  |                              |         |         |                     |                     |

	|         | --driver=docker                                        |                              |         |         |                     |                     |

	|         | --container-runtime=containerd                         |                              |         |         |                     |                     |

	|         | --kubernetes-version=v1.31.2                           |                              |         |         |                     |                     |

	| image   | default-k8s-diff-port-075721                           | default-k8s-diff-port-075721 | jenkins | v1.34.0 | 04 Nov 24 11:24 UTC | 04 Nov 24 11:24 UTC |

	|         | image list --format=json                               |                              |         |         |                     |                     |

	| pause   | -p                                                     | default-k8s-diff-port-075721 | jenkins | v1.34.0 | 04 Nov 24 11:24 UTC | 04 Nov 24 11:24 UTC |

	|         | default-k8s-diff-port-075721                           |                              |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                 |                              |         |         |                     |                     |

	| unpause | -p                                                     | default-k8s-diff-port-075721 | jenkins | v1.34.0 | 04 Nov 24 11:24 UTC | 04 Nov 24 11:24 UTC |

	|         | default-k8s-diff-port-075721                           |                              |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                 |                              |         |         |                     |                     |

	| delete  | -p                                                     | default-k8s-diff-port-075721 | jenkins | v1.34.0 | 04 Nov 24 11:24 UTC | 04 Nov 24 11:24 UTC |

	|         | default-k8s-diff-port-075721                           |                              |         |         |                     |                     |

	| delete  | -p                                                     | default-k8s-diff-port-075721 | jenkins | v1.34.0 | 04 Nov 24 11:24 UTC | 04 Nov 24 11:24 UTC |

	|         | default-k8s-diff-port-075721                           |                              |         |         |                     |                     |

	| start   | -p embed-certs-238832                                  | embed-certs-238832           | jenkins | v1.34.0 | 04 Nov 24 11:24 UTC |                     |

	|         | --memory=2200                                          |                              |         |         |                     |                     |

	|         | --alsologtostderr --wait=true                          |                              |         |         |                     |                     |

	|         | --embed-certs --driver=docker                          |                              |         |         |                     |                     |

	|         | --container-runtime=containerd                         |                              |         |         |                     |                     |

	|         | --kubernetes-version=v1.31.2                           |                              |         |         |                     |                     |

	|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/11/04 11:24:13

	Running on machine: ip-172-31-24-2

	Binary: Built with gc go1.23.2 for linux/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1104 11:24:13.744444  225909 out.go:345] Setting OutFile to fd 1 ...

	I1104 11:24:13.744645  225909 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1104 11:24:13.744672  225909 out.go:358] Setting ErrFile to fd 2...

	I1104 11:24:13.744690  225909 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1104 11:24:13.745058  225909 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19906-2243/.minikube/bin

	I1104 11:24:13.745586  225909 out.go:352] Setting JSON to false

	I1104 11:24:13.746641  225909 start.go:129] hostinfo: {"hostname":"ip-172-31-24-2","uptime":4005,"bootTime":1730715449,"procs":217,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"6d436adf-771e-4269-b9a3-c25fd4fca4f5"}

	I1104 11:24:13.746770  225909 start.go:139] virtualization:  

	I1104 11:24:13.749798  225909 out.go:177] * [embed-certs-238832] minikube v1.34.0 on Ubuntu 20.04 (arm64)

	I1104 11:24:13.751540  225909 out.go:177]   - MINIKUBE_LOCATION=19906

	I1104 11:24:13.751656  225909 notify.go:220] Checking for updates...

	I1104 11:24:13.755583  225909 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1104 11:24:13.757711  225909 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19906-2243/kubeconfig

	I1104 11:24:13.759774  225909 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19906-2243/.minikube

	I1104 11:24:13.761874  225909 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64

	I1104 11:24:13.763975  225909 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1104 11:24:13.766485  225909 config.go:182] Loaded profile config "old-k8s-version-500235": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0

	I1104 11:24:13.766658  225909 driver.go:394] Setting default libvirt URI to qemu:///system

	I1104 11:24:13.788480  225909 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community

	I1104 11:24:13.788621  225909 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1104 11:24:13.852269  225909 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-11-04 11:24:13.840349734 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a

arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge

-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}

	I1104 11:24:13.852393  225909 docker.go:318] overlay module found

	I1104 11:24:13.854612  225909 out.go:177] * Using the docker driver based on user configuration

	I1104 11:24:13.856432  225909 start.go:297] selected driver: docker

	I1104 11:24:13.856449  225909 start.go:901] validating driver "docker" against <nil>

	I1104 11:24:13.856467  225909 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1104 11:24:13.857239  225909 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1104 11:24:13.919493  225909 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:33 OomKillDisable:true NGoroutines:52 SystemTime:2024-11-04 11:24:13.909281762 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a

arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge

-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}

	I1104 11:24:13.919757  225909 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1104 11:24:13.920018  225909 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1104 11:24:13.921952  225909 out.go:177] * Using Docker driver with root privileges

	I1104 11:24:13.923978  225909 cni.go:84] Creating CNI manager for ""

	I1104 11:24:13.924046  225909 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet

	I1104 11:24:13.924060  225909 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I1104 11:24:13.924138  225909 start.go:340] cluster config:

	{Name:embed-certs-238832 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:embed-certs-238832 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain

erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati

cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1104 11:24:13.926271  225909 out.go:177] * Starting "embed-certs-238832" primary control-plane node in "embed-certs-238832" cluster

	I1104 11:24:13.928029  225909 cache.go:121] Beginning downloading kic base image for docker with containerd

	I1104 11:24:13.930256  225909 out.go:177] * Pulling base image v0.0.45-1730282848-19883 ...

	I1104 11:24:13.932173  225909 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime containerd

	I1104 11:24:13.932229  225909 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19906-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4

	I1104 11:24:13.932242  225909 cache.go:56] Caching tarball of preloaded images

	I1104 11:24:13.932248  225909 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 in local docker daemon

	I1104 11:24:13.932323  225909 preload.go:172] Found /home/jenkins/minikube-integration/19906-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4 in cache, skipping download

	I1104 11:24:13.932334  225909 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on containerd

	I1104 11:24:13.932462  225909 profile.go:143] Saving config to /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/config.json ...

	I1104 11:24:13.932490  225909 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/config.json: {Name:mk00ea145b721923ffdfa803c27d190817a4b0e0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1104 11:24:13.952120  225909 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 in local docker daemon, skipping pull

	I1104 11:24:13.952141  225909 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 exists in daemon, skipping load

	I1104 11:24:13.952154  225909 cache.go:194] Successfully downloaded all kic artifacts

	I1104 11:24:13.952187  225909 start.go:360] acquireMachinesLock for embed-certs-238832: {Name:mkc779a74f13444d20c0fad125afd5634f4a0ca6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1104 11:24:13.952304  225909 start.go:364] duration metric: took 95.859µs to acquireMachinesLock for "embed-certs-238832"

	I1104 11:24:13.952333  225909 start.go:93] Provisioning new machine with config: &{Name:embed-certs-238832 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:embed-certs-238832 Namespace:default APIServerHAVIP: APIServe

rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM

etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}

	I1104 11:24:13.952444  225909 start.go:125] createHost starting for "" (driver="docker")

	I1104 11:24:13.956116  225909 out.go:235] * Creating docker container (CPUs=2, Memory=2200MB) ...

	I1104 11:24:13.956404  225909 start.go:159] libmachine.API.Create for "embed-certs-238832" (driver="docker")

	I1104 11:24:13.956450  225909 client.go:168] LocalClient.Create starting

	I1104 11:24:13.956547  225909 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca.pem

	I1104 11:24:13.956588  225909 main.go:141] libmachine: Decoding PEM data...

	I1104 11:24:13.956606  225909 main.go:141] libmachine: Parsing certificate...

	I1104 11:24:13.956662  225909 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19906-2243/.minikube/certs/cert.pem

	I1104 11:24:13.956683  225909 main.go:141] libmachine: Decoding PEM data...

	I1104 11:24:13.956704  225909 main.go:141] libmachine: Parsing certificate...

	I1104 11:24:13.957085  225909 cli_runner.go:164] Run: docker network inspect embed-certs-238832 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1104 11:24:13.976830  225909 cli_runner.go:211] docker network inspect embed-certs-238832 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1104 11:24:13.976912  225909 network_create.go:284] running [docker network inspect embed-certs-238832] to gather additional debugging logs...

	I1104 11:24:13.976935  225909 cli_runner.go:164] Run: docker network inspect embed-certs-238832

	W1104 11:24:13.998964  225909 cli_runner.go:211] docker network inspect embed-certs-238832 returned with exit code 1

	I1104 11:24:13.998997  225909 network_create.go:287] error running [docker network inspect embed-certs-238832]: docker network inspect embed-certs-238832: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network embed-certs-238832 not found

	I1104 11:24:13.999010  225909 network_create.go:289] output of [docker network inspect embed-certs-238832]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network embed-certs-238832 not found

	** /stderr **

	I1104 11:24:13.999117  225909 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1104 11:24:14.017437  225909 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-d5cacb34a917 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:05:15:cb:6c} reservation:<nil>}

	I1104 11:24:14.017880  225909 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-0aa3b7269892 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:10:4b:14:b3} reservation:<nil>}

	I1104 11:24:14.018305  225909 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-cf46c4aa65eb IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:df:3e:00:e9} reservation:<nil>}

	I1104 11:24:14.018862  225909 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40019fad40}

	I1104 11:24:14.018888  225909 network_create.go:124] attempt to create docker network embed-certs-238832 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...

	I1104 11:24:14.018956  225909 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-238832 embed-certs-238832

	I1104 11:24:14.090352  225909 network_create.go:108] docker network embed-certs-238832 192.168.76.0/24 created

	I1104 11:24:14.090383  225909 kic.go:121] calculated static IP "192.168.76.2" for the "embed-certs-238832" container

	I1104 11:24:14.090475  225909 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1104 11:24:14.106617  225909 cli_runner.go:164] Run: docker volume create embed-certs-238832 --label name.minikube.sigs.k8s.io=embed-certs-238832 --label created_by.minikube.sigs.k8s.io=true

	I1104 11:24:14.139921  225909 oci.go:103] Successfully created a docker volume embed-certs-238832

	I1104 11:24:14.140028  225909 cli_runner.go:164] Run: docker run --rm --name embed-certs-238832-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-238832 --entrypoint /usr/bin/test -v embed-certs-238832:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 -d /var/lib

	I1104 11:24:14.774147  225909 oci.go:107] Successfully prepared a docker volume embed-certs-238832

	I1104 11:24:14.774199  225909 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime containerd

	I1104 11:24:14.774218  225909 kic.go:194] Starting extracting preloaded images to volume ...

	I1104 11:24:14.774291  225909 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19906-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-238832:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 -I lz4 -xf /preloaded.tar -C /extractDir

	I1104 11:24:19.209774  214454 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1104 11:24:19.221654  214454 api_server.go:72] duration metric: took 5m59.853054618s to wait for apiserver process to appear ...

	I1104 11:24:19.221677  214454 api_server.go:88] waiting for apiserver healthz status ...

	I1104 11:24:19.221711  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}

	I1104 11:24:19.221779  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I1104 11:24:19.258695  214454 cri.go:89] found id: "3e8112e77fc159650cc821c6474494291af9e444ce6616d1a7b94efe6bbda6ab"

	I1104 11:24:19.258717  214454 cri.go:89] found id: "af8993ac19ddbf1c1b079010f12b22dd569c1d72a7170c14f6d752544c637c7c"

	I1104 11:24:19.258721  214454 cri.go:89] found id: ""

	I1104 11:24:19.258728  214454 logs.go:282] 2 containers: [3e8112e77fc159650cc821c6474494291af9e444ce6616d1a7b94efe6bbda6ab af8993ac19ddbf1c1b079010f12b22dd569c1d72a7170c14f6d752544c637c7c]

	I1104 11:24:19.258784  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.262986  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.266379  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}

	I1104 11:24:19.266454  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I1104 11:24:19.306896  214454 cri.go:89] found id: "264834df4b97845865803778632d50625eabbd66b2547ee289272493acd6170c"

	I1104 11:24:19.306922  214454 cri.go:89] found id: "5f9f6f643b47c2d78af3cabb479505c7d022b211d718f21f9722f20f23462507"

	I1104 11:24:19.306928  214454 cri.go:89] found id: ""

	I1104 11:24:19.306934  214454 logs.go:282] 2 containers: [264834df4b97845865803778632d50625eabbd66b2547ee289272493acd6170c 5f9f6f643b47c2d78af3cabb479505c7d022b211d718f21f9722f20f23462507]

	I1104 11:24:19.306995  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.311636  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.314816  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}

	I1104 11:24:19.314880  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I1104 11:24:19.354839  214454 cri.go:89] found id: "c4409d354d043fdd37e41a0d7a92c17c2c7e8581235a0a1e70b66f54f6ba08ad"

	I1104 11:24:19.354871  214454 cri.go:89] found id: "0eacea8f30c21c6e37db05c925c230cf081403ce010879dec3222a7e8391570a"

	I1104 11:24:19.354877  214454 cri.go:89] found id: ""

	I1104 11:24:19.354884  214454 logs.go:282] 2 containers: [c4409d354d043fdd37e41a0d7a92c17c2c7e8581235a0a1e70b66f54f6ba08ad 0eacea8f30c21c6e37db05c925c230cf081403ce010879dec3222a7e8391570a]

	I1104 11:24:19.354940  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.358831  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.362201  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}

	I1104 11:24:19.362273  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I1104 11:24:19.403127  214454 cri.go:89] found id: "a9495401d77549271b083bfe15401b0ef6a02bcb677de2b829aed6f2a0fd9267"

	I1104 11:24:19.403147  214454 cri.go:89] found id: "315609310246fb02d41baadc72115323d45bf3a159131f75ebbe409d29d740e3"

	I1104 11:24:19.403152  214454 cri.go:89] found id: ""

	I1104 11:24:19.403159  214454 logs.go:282] 2 containers: [a9495401d77549271b083bfe15401b0ef6a02bcb677de2b829aed6f2a0fd9267 315609310246fb02d41baadc72115323d45bf3a159131f75ebbe409d29d740e3]

	I1104 11:24:19.403216  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.406895  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.410751  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}

	I1104 11:24:19.410825  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I1104 11:24:19.455106  214454 cri.go:89] found id: "6f46935ab57f3ae4b043de0fbab5ec523c3e06cd43007d82aa078001cb601364"

	I1104 11:24:19.455130  214454 cri.go:89] found id: "e6255db4359d2fc972f43b37d6434c4571e71ddfe5bd608725f16a5f12803e0e"

	I1104 11:24:19.455136  214454 cri.go:89] found id: ""

	I1104 11:24:19.455148  214454 logs.go:282] 2 containers: [6f46935ab57f3ae4b043de0fbab5ec523c3e06cd43007d82aa078001cb601364 e6255db4359d2fc972f43b37d6434c4571e71ddfe5bd608725f16a5f12803e0e]

	I1104 11:24:19.455205  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.461869  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.465580  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}

	I1104 11:24:19.465660  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I1104 11:24:19.521929  214454 cri.go:89] found id: "35e17075a3193e117833a30cd41003ad02a46f6e354b8efeb4e40a703b3cf693"

	I1104 11:24:19.521951  214454 cri.go:89] found id: "5fc8337da03458cb82a696381c08decbec20e515a804b7d3039041c61f734ae0"

	I1104 11:24:19.521956  214454 cri.go:89] found id: ""

	I1104 11:24:19.521962  214454 logs.go:282] 2 containers: [35e17075a3193e117833a30cd41003ad02a46f6e354b8efeb4e40a703b3cf693 5fc8337da03458cb82a696381c08decbec20e515a804b7d3039041c61f734ae0]

	I1104 11:24:19.522080  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.526037  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.529888  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}

	I1104 11:24:19.529954  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I1104 11:24:19.596049  214454 cri.go:89] found id: "c97f229f531420939c1e1384e49e4b9908698c727ac4354a27b3e19689dcc0bb"

	I1104 11:24:19.596069  214454 cri.go:89] found id: "55de0e155bc4227fa1a7b7fbfa0a89934a702ea6e0398a4160b6f36cd9f30f1d"

	I1104 11:24:19.596073  214454 cri.go:89] found id: ""

	I1104 11:24:19.596083  214454 logs.go:282] 2 containers: [c97f229f531420939c1e1384e49e4b9908698c727ac4354a27b3e19689dcc0bb 55de0e155bc4227fa1a7b7fbfa0a89934a702ea6e0398a4160b6f36cd9f30f1d]

	I1104 11:24:19.596137  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.603262  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.608309  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}

	I1104 11:24:19.608396  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard

	I1104 11:24:19.680057  214454 cri.go:89] found id: "1796fcc40741bc21674b2d1e7ac63a200f8221893412d53b1a38dfee4597e57f"

	I1104 11:24:19.680078  214454 cri.go:89] found id: ""

	I1104 11:24:19.680086  214454 logs.go:282] 1 containers: [1796fcc40741bc21674b2d1e7ac63a200f8221893412d53b1a38dfee4597e57f]

	I1104 11:24:19.680142  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.690311  214454 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}

	I1104 11:24:19.690382  214454 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner

	I1104 11:24:19.746226  214454 cri.go:89] found id: "c50257d1470aacd8de9da23f4d89da365c3a14a55f18a6a61447c58175cffb43"

	I1104 11:24:19.746245  214454 cri.go:89] found id: "796847166109e53e702d6b306fa9c019e4fc48de5cc9c8ae2b0dc01439739800"

	I1104 11:24:19.746250  214454 cri.go:89] found id: ""

	I1104 11:24:19.746257  214454 logs.go:282] 2 containers: [c50257d1470aacd8de9da23f4d89da365c3a14a55f18a6a61447c58175cffb43 796847166109e53e702d6b306fa9c019e4fc48de5cc9c8ae2b0dc01439739800]

	I1104 11:24:19.746310  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.750587  214454 ssh_runner.go:195] Run: which crictl

	I1104 11:24:19.754575  214454 logs.go:123] Gathering logs for kube-scheduler [315609310246fb02d41baadc72115323d45bf3a159131f75ebbe409d29d740e3] ...

	I1104 11:24:19.754656  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 315609310246fb02d41baadc72115323d45bf3a159131f75ebbe409d29d740e3"

	I1104 11:24:19.810258  214454 logs.go:123] Gathering logs for kube-controller-manager [5fc8337da03458cb82a696381c08decbec20e515a804b7d3039041c61f734ae0] ...

	I1104 11:24:19.810397  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5fc8337da03458cb82a696381c08decbec20e515a804b7d3039041c61f734ae0"

	I1104 11:24:19.957537  214454 logs.go:123] Gathering logs for container status ...

	I1104 11:24:19.957575  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1104 11:24:20.041252  214454 logs.go:123] Gathering logs for kubelet ...

	I1104 11:24:20.041353  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W1104 11:24:20.175092  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.423612     660 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.175341  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.424270     660 reflector.go:138] object-"kube-system"/"storage-provisioner-token-l9dc6": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-l9dc6" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.175556  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.424755     660 reflector.go:138] object-"default"/"default-token-z9qg4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-z9qg4" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.175775  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.430997     660 reflector.go:138] object-"kube-system"/"metrics-server-token-xjxh8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-xjxh8" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.175992  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.431452     660 reflector.go:138] object-"kube-system"/"kindnet-token-f2jbd": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-f2jbd" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.186107  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.431965     660 reflector.go:138] object-"kube-system"/"coredns-token-lbpdj": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-lbpdj" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.186368  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.432919     660 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.186635  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:39 old-k8s-version-500235 kubelet[660]: E1104 11:18:39.433260     660 reflector.go:138] object-"kube-system"/"kube-proxy-token-5q4pm": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-5q4pm" is forbidden: User "system:node:old-k8s-version-500235" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-500235' and this object

	W1104 11:24:20.208682  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:42 old-k8s-version-500235 kubelet[660]: E1104 11:18:42.297858     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	W1104 11:24:20.208945  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:42 old-k8s-version-500235 kubelet[660]: E1104 11:18:42.775321     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.223786  214454 logs.go:138] Found kubelet problem: Nov 04 11:18:54 old-k8s-version-500235 kubelet[660]: E1104 11:18:54.479766     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	W1104 11:24:20.228692  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:05 old-k8s-version-500235 kubelet[660]: E1104 11:19:05.899280     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.229046  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:06 old-k8s-version-500235 kubelet[660]: E1104 11:19:06.904034     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.229254  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:07 old-k8s-version-500235 kubelet[660]: E1104 11:19:07.471254     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.229929  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:11 old-k8s-version-500235 kubelet[660]: E1104 11:19:11.841820     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.230368  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:12 old-k8s-version-500235 kubelet[660]: E1104 11:19:12.921990     660 pod_workers.go:191] Error syncing pod d3ca41cd-2794-4f2c-83f8-41d4258ac284 ("storage-provisioner_kube-system(d3ca41cd-2794-4f2c-83f8-41d4258ac284)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(d3ca41cd-2794-4f2c-83f8-41d4258ac284)"

	W1104 11:24:20.241478  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:20 old-k8s-version-500235 kubelet[660]: E1104 11:19:20.483478     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	W1104 11:24:20.242095  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:23 old-k8s-version-500235 kubelet[660]: E1104 11:19:23.967756     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.250709  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:31 old-k8s-version-500235 kubelet[660]: E1104 11:19:31.843037     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.250919  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:32 old-k8s-version-500235 kubelet[660]: E1104 11:19:32.471012     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.251102  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:45 old-k8s-version-500235 kubelet[660]: E1104 11:19:45.475690     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.251689  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:47 old-k8s-version-500235 kubelet[660]: E1104 11:19:47.055655     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.252018  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:51 old-k8s-version-500235 kubelet[660]: E1104 11:19:51.841700     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.252200  214454 logs.go:138] Found kubelet problem: Nov 04 11:19:56 old-k8s-version-500235 kubelet[660]: E1104 11:19:56.470607     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.252541  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:02 old-k8s-version-500235 kubelet[660]: E1104 11:20:02.470249     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.262114  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:11 old-k8s-version-500235 kubelet[660]: E1104 11:20:11.483367     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	W1104 11:24:20.262463  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:15 old-k8s-version-500235 kubelet[660]: E1104 11:20:15.471716     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.263890  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:22 old-k8s-version-500235 kubelet[660]: E1104 11:20:22.470725     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.265328  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:31 old-k8s-version-500235 kubelet[660]: E1104 11:20:31.190004     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.267424  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:32 old-k8s-version-500235 kubelet[660]: E1104 11:20:32.194342     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.267628  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:37 old-k8s-version-500235 kubelet[660]: E1104 11:20:37.472542     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.267962  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:43 old-k8s-version-500235 kubelet[660]: E1104 11:20:43.470419     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.268156  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:51 old-k8s-version-500235 kubelet[660]: E1104 11:20:51.471084     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.269596  214454 logs.go:138] Found kubelet problem: Nov 04 11:20:55 old-k8s-version-500235 kubelet[660]: E1104 11:20:55.470447     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.269796  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:04 old-k8s-version-500235 kubelet[660]: E1104 11:21:04.471097     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.270396  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:08 old-k8s-version-500235 kubelet[660]: E1104 11:21:08.470384     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.270730  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:16 old-k8s-version-500235 kubelet[660]: E1104 11:21:16.470760     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.272229  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:22 old-k8s-version-500235 kubelet[660]: E1104 11:21:22.470760     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.272442  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:31 old-k8s-version-500235 kubelet[660]: E1104 11:21:31.470642     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.272768  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:34 old-k8s-version-500235 kubelet[660]: E1104 11:21:34.470236     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.280285  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:43 old-k8s-version-500235 kubelet[660]: E1104 11:21:43.481904     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	W1104 11:24:20.283000  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:49 old-k8s-version-500235 kubelet[660]: E1104 11:21:49.470563     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.284335  214454 logs.go:138] Found kubelet problem: Nov 04 11:21:55 old-k8s-version-500235 kubelet[660]: E1104 11:21:55.470818     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.286921  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:02 old-k8s-version-500235 kubelet[660]: E1104 11:22:02.453501     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.287126  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:09 old-k8s-version-500235 kubelet[660]: E1104 11:22:09.489119     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.287458  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:11 old-k8s-version-500235 kubelet[660]: E1104 11:22:11.842996     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.287643  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:23 old-k8s-version-500235 kubelet[660]: E1104 11:22:23.471189     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.287983  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:26 old-k8s-version-500235 kubelet[660]: E1104 11:22:26.470264     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.288167  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:36 old-k8s-version-500235 kubelet[660]: E1104 11:22:36.470686     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.288502  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:39 old-k8s-version-500235 kubelet[660]: E1104 11:22:39.471880     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.288685  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:48 old-k8s-version-500235 kubelet[660]: E1104 11:22:48.470674     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.289013  214454 logs.go:138] Found kubelet problem: Nov 04 11:22:51 old-k8s-version-500235 kubelet[660]: E1104 11:22:51.470726     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.289198  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:02 old-k8s-version-500235 kubelet[660]: E1104 11:23:02.470754     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.289525  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:03 old-k8s-version-500235 kubelet[660]: E1104 11:23:03.474775     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.289709  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:13 old-k8s-version-500235 kubelet[660]: E1104 11:23:13.471159     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.290041  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:18 old-k8s-version-500235 kubelet[660]: E1104 11:23:18.470145     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.291203  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:24 old-k8s-version-500235 kubelet[660]: E1104 11:23:24.470904     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.293634  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:32 old-k8s-version-500235 kubelet[660]: E1104 11:23:32.470773     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.295399  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:38 old-k8s-version-500235 kubelet[660]: E1104 11:23:38.470775     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.296563  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:44 old-k8s-version-500235 kubelet[660]: E1104 11:23:44.470228     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.296766  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:49 old-k8s-version-500235 kubelet[660]: E1104 11:23:49.471350     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.297095  214454 logs.go:138] Found kubelet problem: Nov 04 11:23:57 old-k8s-version-500235 kubelet[660]: E1104 11:23:57.471216     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:20.297285  214454 logs.go:138] Found kubelet problem: Nov 04 11:24:00 old-k8s-version-500235 kubelet[660]: E1104 11:24:00.472460     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.297469  214454 logs.go:138] Found kubelet problem: Nov 04 11:24:11 old-k8s-version-500235 kubelet[660]: E1104 11:24:11.473454     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:20.297799  214454 logs.go:138] Found kubelet problem: Nov 04 11:24:12 old-k8s-version-500235 kubelet[660]: E1104 11:24:12.470610     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	I1104 11:24:20.297810  214454 logs.go:123] Gathering logs for kube-apiserver [af8993ac19ddbf1c1b079010f12b22dd569c1d72a7170c14f6d752544c637c7c] ...

	I1104 11:24:20.297824  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 af8993ac19ddbf1c1b079010f12b22dd569c1d72a7170c14f6d752544c637c7c"

	I1104 11:24:20.404326  214454 logs.go:123] Gathering logs for etcd [264834df4b97845865803778632d50625eabbd66b2547ee289272493acd6170c] ...

	I1104 11:24:20.404377  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 264834df4b97845865803778632d50625eabbd66b2547ee289272493acd6170c"

	I1104 11:24:20.488836  214454 logs.go:123] Gathering logs for kube-scheduler [a9495401d77549271b083bfe15401b0ef6a02bcb677de2b829aed6f2a0fd9267] ...

	I1104 11:24:20.488872  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a9495401d77549271b083bfe15401b0ef6a02bcb677de2b829aed6f2a0fd9267"

	I1104 11:24:20.557329  214454 logs.go:123] Gathering logs for kindnet [55de0e155bc4227fa1a7b7fbfa0a89934a702ea6e0398a4160b6f36cd9f30f1d] ...

	I1104 11:24:20.557355  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 55de0e155bc4227fa1a7b7fbfa0a89934a702ea6e0398a4160b6f36cd9f30f1d"

	I1104 11:24:20.669198  214454 logs.go:123] Gathering logs for kubernetes-dashboard [1796fcc40741bc21674b2d1e7ac63a200f8221893412d53b1a38dfee4597e57f] ...

	I1104 11:24:20.669227  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1796fcc40741bc21674b2d1e7ac63a200f8221893412d53b1a38dfee4597e57f"

	I1104 11:24:20.792876  214454 logs.go:123] Gathering logs for storage-provisioner [796847166109e53e702d6b306fa9c019e4fc48de5cc9c8ae2b0dc01439739800] ...

	I1104 11:24:20.792908  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 796847166109e53e702d6b306fa9c019e4fc48de5cc9c8ae2b0dc01439739800"

	I1104 11:24:20.928326  214454 logs.go:123] Gathering logs for dmesg ...

	I1104 11:24:20.928363  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1104 11:24:20.986646  214454 logs.go:123] Gathering logs for describe nodes ...

	I1104 11:24:20.986728  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1104 11:24:19.503254  225909 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19906-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-238832:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 -I lz4 -xf /preloaded.tar -C /extractDir: (4.728914936s)

	I1104 11:24:19.503283  225909 kic.go:203] duration metric: took 4.729061329s to extract preloaded images to volume ...

	W1104 11:24:19.503430  225909 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.

	I1104 11:24:19.503542  225909 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"

	I1104 11:24:19.584350  225909 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-238832 --name embed-certs-238832 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-238832 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-238832 --network embed-certs-238832 --ip 192.168.76.2 --volume embed-certs-238832:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4

	I1104 11:24:20.050868  225909 cli_runner.go:164] Run: docker container inspect embed-certs-238832 --format={{.State.Running}}

	I1104 11:24:20.098651  225909 cli_runner.go:164] Run: docker container inspect embed-certs-238832 --format={{.State.Status}}

	I1104 11:24:20.125287  225909 cli_runner.go:164] Run: docker exec embed-certs-238832 stat /var/lib/dpkg/alternatives/iptables

	I1104 11:24:20.223454  225909 oci.go:144] the created container "embed-certs-238832" has a running status.

	I1104 11:24:20.223544  225909 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19906-2243/.minikube/machines/embed-certs-238832/id_rsa...

	I1104 11:24:20.789612  225909 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19906-2243/.minikube/machines/embed-certs-238832/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

	I1104 11:24:20.814762  225909 cli_runner.go:164] Run: docker container inspect embed-certs-238832 --format={{.State.Status}}

	I1104 11:24:20.839776  225909 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys

	I1104 11:24:20.839798  225909 kic_runner.go:114] Args: [docker exec --privileged embed-certs-238832 chown docker:docker /home/docker/.ssh/authorized_keys]

	I1104 11:24:20.938281  225909 cli_runner.go:164] Run: docker container inspect embed-certs-238832 --format={{.State.Status}}

	I1104 11:24:20.963165  225909 machine.go:93] provisionDockerMachine start ...

	I1104 11:24:20.963249  225909 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-238832

	I1104 11:24:20.990755  225909 main.go:141] libmachine: Using SSH client type: native

	I1104 11:24:20.991032  225909 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x415580] 0x417dc0 <nil>  [] 0s} 127.0.0.1 33073 <nil> <nil>}

	I1104 11:24:20.991042  225909 main.go:141] libmachine: About to run SSH command:

	hostname

	I1104 11:24:20.991569  225909 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:38880->127.0.0.1:33073: read: connection reset by peer

	I1104 11:24:21.261313  214454 logs.go:123] Gathering logs for etcd [5f9f6f643b47c2d78af3cabb479505c7d022b211d718f21f9722f20f23462507] ...

	I1104 11:24:21.261413  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f9f6f643b47c2d78af3cabb479505c7d022b211d718f21f9722f20f23462507"

	I1104 11:24:21.355008  214454 logs.go:123] Gathering logs for kube-controller-manager [35e17075a3193e117833a30cd41003ad02a46f6e354b8efeb4e40a703b3cf693] ...

	I1104 11:24:21.355041  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 35e17075a3193e117833a30cd41003ad02a46f6e354b8efeb4e40a703b3cf693"

	I1104 11:24:21.419460  214454 logs.go:123] Gathering logs for kube-apiserver [3e8112e77fc159650cc821c6474494291af9e444ce6616d1a7b94efe6bbda6ab] ...

	I1104 11:24:21.419494  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3e8112e77fc159650cc821c6474494291af9e444ce6616d1a7b94efe6bbda6ab"

	I1104 11:24:21.522241  214454 logs.go:123] Gathering logs for kube-proxy [e6255db4359d2fc972f43b37d6434c4571e71ddfe5bd608725f16a5f12803e0e] ...

	I1104 11:24:21.522278  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e6255db4359d2fc972f43b37d6434c4571e71ddfe5bd608725f16a5f12803e0e"

	I1104 11:24:21.573603  214454 logs.go:123] Gathering logs for storage-provisioner [c50257d1470aacd8de9da23f4d89da365c3a14a55f18a6a61447c58175cffb43] ...

	I1104 11:24:21.573679  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c50257d1470aacd8de9da23f4d89da365c3a14a55f18a6a61447c58175cffb43"

	I1104 11:24:21.626213  214454 logs.go:123] Gathering logs for containerd ...

	I1104 11:24:21.626285  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"

	I1104 11:24:21.693384  214454 logs.go:123] Gathering logs for coredns [c4409d354d043fdd37e41a0d7a92c17c2c7e8581235a0a1e70b66f54f6ba08ad] ...

	I1104 11:24:21.693422  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c4409d354d043fdd37e41a0d7a92c17c2c7e8581235a0a1e70b66f54f6ba08ad"

	I1104 11:24:21.750219  214454 logs.go:123] Gathering logs for coredns [0eacea8f30c21c6e37db05c925c230cf081403ce010879dec3222a7e8391570a] ...

	I1104 11:24:21.750252  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0eacea8f30c21c6e37db05c925c230cf081403ce010879dec3222a7e8391570a"

	I1104 11:24:21.811584  214454 logs.go:123] Gathering logs for kube-proxy [6f46935ab57f3ae4b043de0fbab5ec523c3e06cd43007d82aa078001cb601364] ...

	I1104 11:24:21.811615  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6f46935ab57f3ae4b043de0fbab5ec523c3e06cd43007d82aa078001cb601364"

	I1104 11:24:21.860823  214454 logs.go:123] Gathering logs for kindnet [c97f229f531420939c1e1384e49e4b9908698c727ac4354a27b3e19689dcc0bb] ...

	I1104 11:24:21.860901  214454 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c97f229f531420939c1e1384e49e4b9908698c727ac4354a27b3e19689dcc0bb"

	I1104 11:24:21.928221  214454 out.go:358] Setting ErrFile to fd 2...

	I1104 11:24:21.928247  214454 out.go:392] TERM=,COLORTERM=, which probably does not support color

	W1104 11:24:21.928369  214454 out.go:270] X Problems detected in kubelet:

	W1104 11:24:21.928387  214454 out.go:270]   Nov 04 11:23:49 old-k8s-version-500235 kubelet[660]: E1104 11:23:49.471350     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:21.928396  214454 out.go:270]   Nov 04 11:23:57 old-k8s-version-500235 kubelet[660]: E1104 11:23:57.471216     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	W1104 11:24:21.928427  214454 out.go:270]   Nov 04 11:24:00 old-k8s-version-500235 kubelet[660]: E1104 11:24:00.472460     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:21.928437  214454 out.go:270]   Nov 04 11:24:11 old-k8s-version-500235 kubelet[660]: E1104 11:24:11.473454     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	W1104 11:24:21.928447  214454 out.go:270]   Nov 04 11:24:12 old-k8s-version-500235 kubelet[660]: E1104 11:24:12.470610     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	I1104 11:24:21.928453  214454 out.go:358] Setting ErrFile to fd 2...

	I1104 11:24:21.928460  214454 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1104 11:24:24.126562  225909 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-238832

	I1104 11:24:24.126588  225909 ubuntu.go:169] provisioning hostname "embed-certs-238832"

	I1104 11:24:24.126683  225909 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-238832

	I1104 11:24:24.146199  225909 main.go:141] libmachine: Using SSH client type: native

	I1104 11:24:24.146444  225909 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x415580] 0x417dc0 <nil>  [] 0s} 127.0.0.1 33073 <nil> <nil>}

	I1104 11:24:24.146463  225909 main.go:141] libmachine: About to run SSH command:

	sudo hostname embed-certs-238832 && echo "embed-certs-238832" | sudo tee /etc/hostname

	I1104 11:24:24.287869  225909 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-238832

	I1104 11:24:24.287950  225909 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-238832

	I1104 11:24:24.306142  225909 main.go:141] libmachine: Using SSH client type: native

	I1104 11:24:24.306407  225909 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x415580] 0x417dc0 <nil>  [] 0s} 127.0.0.1 33073 <nil> <nil>}

	I1104 11:24:24.306430  225909 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sembed-certs-238832' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-238832/g' /etc/hosts;

				else 

					echo '127.0.1.1 embed-certs-238832' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1104 11:24:24.430665  225909 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1104 11:24:24.430757  225909 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19906-2243/.minikube CaCertPath:/home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19906-2243/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19906-2243/.minikube}

	I1104 11:24:24.430814  225909 ubuntu.go:177] setting up certificates

	I1104 11:24:24.430842  225909 provision.go:84] configureAuth start

	I1104 11:24:24.430947  225909 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-238832

	I1104 11:24:24.447972  225909 provision.go:143] copyHostCerts

	I1104 11:24:24.448052  225909 exec_runner.go:144] found /home/jenkins/minikube-integration/19906-2243/.minikube/ca.pem, removing ...

	I1104 11:24:24.448066  225909 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19906-2243/.minikube/ca.pem

	I1104 11:24:24.448147  225909 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19906-2243/.minikube/ca.pem (1082 bytes)

	I1104 11:24:24.448253  225909 exec_runner.go:144] found /home/jenkins/minikube-integration/19906-2243/.minikube/cert.pem, removing ...

	I1104 11:24:24.448263  225909 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19906-2243/.minikube/cert.pem

	I1104 11:24:24.448291  225909 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19906-2243/.minikube/cert.pem (1123 bytes)

	I1104 11:24:24.448381  225909 exec_runner.go:144] found /home/jenkins/minikube-integration/19906-2243/.minikube/key.pem, removing ...

	I1104 11:24:24.448392  225909 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19906-2243/.minikube/key.pem

	I1104 11:24:24.448420  225909 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19906-2243/.minikube/key.pem (1679 bytes)

	I1104 11:24:24.448483  225909 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19906-2243/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca-key.pem org=jenkins.embed-certs-238832 san=[127.0.0.1 192.168.76.2 embed-certs-238832 localhost minikube]

	I1104 11:24:25.163846  225909 provision.go:177] copyRemoteCerts

	I1104 11:24:25.163925  225909 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1104 11:24:25.163969  225909 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-238832

	I1104 11:24:25.181765  225909 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/embed-certs-238832/id_rsa Username:docker}

	I1104 11:24:25.278486  225909 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)

	I1104 11:24:25.307976  225909 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1104 11:24:25.333417  225909 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1104 11:24:25.358706  225909 provision.go:87] duration metric: took 927.83921ms to configureAuth

	I1104 11:24:25.358734  225909 ubuntu.go:193] setting minikube options for container-runtime

	I1104 11:24:25.358913  225909 config.go:182] Loaded profile config "embed-certs-238832": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2

	I1104 11:24:25.358926  225909 machine.go:96] duration metric: took 4.395744043s to provisionDockerMachine

	I1104 11:24:25.358933  225909 client.go:171] duration metric: took 11.402473044s to LocalClient.Create

	I1104 11:24:25.358948  225909 start.go:167] duration metric: took 11.402545494s to libmachine.API.Create "embed-certs-238832"

	I1104 11:24:25.358956  225909 start.go:293] postStartSetup for "embed-certs-238832" (driver="docker")

	I1104 11:24:25.358965  225909 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1104 11:24:25.359021  225909 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1104 11:24:25.359074  225909 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-238832

	I1104 11:24:25.375834  225909 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/embed-certs-238832/id_rsa Username:docker}

	I1104 11:24:25.468550  225909 ssh_runner.go:195] Run: cat /etc/os-release

	I1104 11:24:25.476476  225909 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1104 11:24:25.476516  225909 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1104 11:24:25.476527  225909 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1104 11:24:25.476534  225909 info.go:137] Remote host: Ubuntu 22.04.5 LTS

	I1104 11:24:25.476545  225909 filesync.go:126] Scanning /home/jenkins/minikube-integration/19906-2243/.minikube/addons for local assets ...

	I1104 11:24:25.476604  225909 filesync.go:126] Scanning /home/jenkins/minikube-integration/19906-2243/.minikube/files for local assets ...

	I1104 11:24:25.476695  225909 filesync.go:149] local asset: /home/jenkins/minikube-integration/19906-2243/.minikube/files/etc/ssl/certs/76872.pem -> 76872.pem in /etc/ssl/certs

	I1104 11:24:25.476804  225909 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1104 11:24:25.486259  225909 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/files/etc/ssl/certs/76872.pem --> /etc/ssl/certs/76872.pem (1708 bytes)

	I1104 11:24:25.512282  225909 start.go:296] duration metric: took 153.311879ms for postStartSetup

	I1104 11:24:25.512664  225909 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-238832

	I1104 11:24:25.529345  225909 profile.go:143] Saving config to /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/config.json ...

	I1104 11:24:25.529628  225909 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1104 11:24:25.529672  225909 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-238832

	I1104 11:24:25.545683  225909 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/embed-certs-238832/id_rsa Username:docker}

	I1104 11:24:25.631356  225909 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1104 11:24:25.636017  225909 start.go:128] duration metric: took 11.683558923s to createHost

	I1104 11:24:25.636042  225909 start.go:83] releasing machines lock for "embed-certs-238832", held for 11.683725887s

	I1104 11:24:25.636115  225909 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-238832

	I1104 11:24:25.653228  225909 ssh_runner.go:195] Run: cat /version.json

	I1104 11:24:25.653241  225909 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1104 11:24:25.653299  225909 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-238832

	I1104 11:24:25.653321  225909 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-238832

	I1104 11:24:25.671795  225909 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/embed-certs-238832/id_rsa Username:docker}

	I1104 11:24:25.686390  225909 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33073 SSHKeyPath:/home/jenkins/minikube-integration/19906-2243/.minikube/machines/embed-certs-238832/id_rsa Username:docker}

	I1104 11:24:25.766553  225909 ssh_runner.go:195] Run: systemctl --version

	I1104 11:24:25.917303  225909 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1104 11:24:25.922150  225909 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;

	I1104 11:24:25.949652  225909 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found

	I1104 11:24:25.949745  225909 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1104 11:24:25.981465  225909 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)

	I1104 11:24:25.981488  225909 start.go:495] detecting cgroup driver to use...

	I1104 11:24:25.981521  225909 detect.go:187] detected "cgroupfs" cgroup driver on host os

	I1104 11:24:25.981575  225909 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I1104 11:24:25.994690  225909 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I1104 11:24:26.011260  225909 docker.go:217] disabling cri-docker service (if available) ...

	I1104 11:24:26.011334  225909 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I1104 11:24:26.026653  225909 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I1104 11:24:26.042761  225909 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I1104 11:24:26.133904  225909 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I1104 11:24:26.227654  225909 docker.go:233] disabling docker service ...

	I1104 11:24:26.227724  225909 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I1104 11:24:26.255280  225909 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I1104 11:24:26.272623  225909 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I1104 11:24:26.377624  225909 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I1104 11:24:26.469479  225909 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1104 11:24:26.482255  225909 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I1104 11:24:26.500696  225909 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"

	I1104 11:24:26.512918  225909 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I1104 11:24:26.524234  225909 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I1104 11:24:26.524315  225909 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I1104 11:24:26.536327  225909 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1104 11:24:26.547429  225909 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I1104 11:24:26.561587  225909 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I1104 11:24:26.573858  225909 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1104 11:24:26.585311  225909 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I1104 11:24:26.596751  225909 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I1104 11:24:26.607916  225909 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I1104 11:24:26.618967  225909 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1104 11:24:26.628218  225909 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1104 11:24:26.637611  225909 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1104 11:24:26.723838  225909 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I1104 11:24:26.882810  225909 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock

	I1104 11:24:26.882890  225909 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock

	I1104 11:24:26.887337  225909 start.go:563] Will wait 60s for crictl version

	I1104 11:24:26.887405  225909 ssh_runner.go:195] Run: which crictl

	I1104 11:24:26.890780  225909 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1104 11:24:26.935559  225909 start.go:579] Version:  0.1.0

	RuntimeName:  containerd

	RuntimeVersion:  1.7.22

	RuntimeApiVersion:  v1

	I1104 11:24:26.935633  225909 ssh_runner.go:195] Run: containerd --version

	I1104 11:24:26.962117  225909 ssh_runner.go:195] Run: containerd --version

	I1104 11:24:26.989894  225909 out.go:177] * Preparing Kubernetes v1.31.2 on containerd 1.7.22 ...

	I1104 11:24:26.991995  225909 cli_runner.go:164] Run: docker network inspect embed-certs-238832 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1104 11:24:27.008826  225909 ssh_runner.go:195] Run: grep 192.168.76.1	host.minikube.internal$ /etc/hosts

	I1104 11:24:27.013073  225909 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1104 11:24:27.025592  225909 kubeadm.go:883] updating cluster {Name:embed-certs-238832 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:embed-certs-238832 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP

IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:

false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I1104 11:24:27.025727  225909 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime containerd

	I1104 11:24:27.025790  225909 ssh_runner.go:195] Run: sudo crictl images --output json

	I1104 11:24:27.064308  225909 containerd.go:627] all images are preloaded for containerd runtime.

	I1104 11:24:27.064333  225909 containerd.go:534] Images already preloaded, skipping extraction

	I1104 11:24:27.064412  225909 ssh_runner.go:195] Run: sudo crictl images --output json

	I1104 11:24:27.106249  225909 containerd.go:627] all images are preloaded for containerd runtime.

	I1104 11:24:27.106273  225909 cache_images.go:84] Images are preloaded, skipping loading

	I1104 11:24:27.106282  225909 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.31.2 containerd true true} ...

	I1104 11:24:27.106372  225909 kubeadm.go:946] kubelet [Unit]

	Wants=containerd.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-238832 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2

	[Install]

	 config:

	{KubernetesVersion:v1.31.2 ClusterName:embed-certs-238832 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I1104 11:24:27.106448  225909 ssh_runner.go:195] Run: sudo crictl info

	I1104 11:24:27.152533  225909 cni.go:84] Creating CNI manager for ""

	I1104 11:24:27.152556  225909 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet

	I1104 11:24:27.152565  225909 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I1104 11:24:27.152586  225909 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.31.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-238832 NodeName:embed-certs-238832 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo

dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1104 11:24:27.152707  225909 kubeadm.go:195] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.76.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///run/containerd/containerd.sock

	  name: "embed-certs-238832"

	  kubeletExtraArgs:

	    - name: "node-ip"

	      value: "192.168.76.2"

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]

	  extraArgs:

	    - name: "enable-admission-plugins"

	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    - name: "allocate-node-cidrs"

	      value: "true"

	    - name: "leader-elect"

	      value: "false"

	scheduler:

	  extraArgs:

	    - name: "leader-elect"

	      value: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      - name: "proxy-refresh-interval"

	        value: "70000"

	kubernetesVersion: v1.31.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///run/containerd/containerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1104 11:24:27.152776  225909 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.2

	I1104 11:24:27.162248  225909 binaries.go:44] Found k8s binaries, skipping transfer

	I1104 11:24:27.162316  225909 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1104 11:24:27.171198  225909 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)

	I1104 11:24:27.189961  225909 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1104 11:24:27.208722  225909 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2308 bytes)

	I1104 11:24:27.226239  225909 ssh_runner.go:195] Run: grep 192.168.76.2	control-plane.minikube.internal$ /etc/hosts

	I1104 11:24:27.229939  225909 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1104 11:24:27.241102  225909 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1104 11:24:27.327165  225909 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1104 11:24:27.343108  225909 certs.go:68] Setting up /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832 for IP: 192.168.76.2

	I1104 11:24:27.343129  225909 certs.go:194] generating shared ca certs ...

	I1104 11:24:27.343145  225909 certs.go:226] acquiring lock for ca certs: {Name:mkd977a3ad99222c5fc8a72aa0efe5fbfd33dbdc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1104 11:24:27.343289  225909 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19906-2243/.minikube/ca.key

	I1104 11:24:27.343342  225909 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19906-2243/.minikube/proxy-client-ca.key

	I1104 11:24:27.343353  225909 certs.go:256] generating profile certs ...

	I1104 11:24:27.343406  225909 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/client.key

	I1104 11:24:27.343422  225909 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/client.crt with IP's: []

	I1104 11:24:27.874842  225909 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/client.crt ...

	I1104 11:24:27.874871  225909 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/client.crt: {Name:mkabcc666aeac2c05f3017f720a81aadabd1e938 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1104 11:24:27.875634  225909 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/client.key ...

	I1104 11:24:27.875650  225909 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/client.key: {Name:mk435664895dd5eb460072f6fd7d3b8ab4326602 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1104 11:24:27.875757  225909 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/apiserver.key.2dfad869

	I1104 11:24:27.875773  225909 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/apiserver.crt.2dfad869 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.76.2]

	I1104 11:24:28.135535  225909 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/apiserver.crt.2dfad869 ...

	I1104 11:24:28.135567  225909 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/apiserver.crt.2dfad869: {Name:mk7f1509132676d38156aa5ced197cd7efc35a18 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1104 11:24:28.136250  225909 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/apiserver.key.2dfad869 ...

	I1104 11:24:28.136268  225909 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/apiserver.key.2dfad869: {Name:mk722f4d1f3d0488a1bb30fb7f99a0f2a3da642b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1104 11:24:28.136364  225909 certs.go:381] copying /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/apiserver.crt.2dfad869 -> /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/apiserver.crt

	I1104 11:24:28.136451  225909 certs.go:385] copying /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/apiserver.key.2dfad869 -> /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/apiserver.key

	I1104 11:24:28.136523  225909 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/proxy-client.key

	I1104 11:24:28.136544  225909 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/proxy-client.crt with IP's: []

	I1104 11:24:29.022388  225909 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/proxy-client.crt ...

	I1104 11:24:29.022424  225909 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/proxy-client.crt: {Name:mk0d3aa5b10e951b096367bc369546b772244e3d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1104 11:24:29.022636  225909 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/proxy-client.key ...

	I1104 11:24:29.022651  225909 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/proxy-client.key: {Name:mkccd0b0dae728fd113dd56a475920578f366417 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1104 11:24:29.022849  225909 certs.go:484] found cert: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/7687.pem (1338 bytes)

	W1104 11:24:29.022897  225909 certs.go:480] ignoring /home/jenkins/minikube-integration/19906-2243/.minikube/certs/7687_empty.pem, impossibly tiny 0 bytes

	I1104 11:24:29.022910  225909 certs.go:484] found cert: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca-key.pem (1679 bytes)

	I1104 11:24:29.022936  225909 certs.go:484] found cert: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/ca.pem (1082 bytes)

	I1104 11:24:29.022963  225909 certs.go:484] found cert: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/cert.pem (1123 bytes)

	I1104 11:24:29.022991  225909 certs.go:484] found cert: /home/jenkins/minikube-integration/19906-2243/.minikube/certs/key.pem (1679 bytes)

	I1104 11:24:29.023037  225909 certs.go:484] found cert: /home/jenkins/minikube-integration/19906-2243/.minikube/files/etc/ssl/certs/76872.pem (1708 bytes)

	I1104 11:24:29.023708  225909 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1104 11:24:29.053029  225909 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I1104 11:24:29.079520  225909 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1104 11:24:29.107041  225909 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I1104 11:24:29.138464  225909 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)

	I1104 11:24:29.167615  225909 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1104 11:24:29.196656  225909 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1104 11:24:29.224653  225909 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/embed-certs-238832/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1104 11:24:29.249551  225909 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1104 11:24:29.276416  225909 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/certs/7687.pem --> /usr/share/ca-certificates/7687.pem (1338 bytes)

	I1104 11:24:29.302544  225909 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19906-2243/.minikube/files/etc/ssl/certs/76872.pem --> /usr/share/ca-certificates/76872.pem (1708 bytes)

	I1104 11:24:29.328038  225909 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1104 11:24:29.346890  225909 ssh_runner.go:195] Run: openssl version

	I1104 11:24:29.352500  225909 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7687.pem && ln -fs /usr/share/ca-certificates/7687.pem /etc/ssl/certs/7687.pem"

	I1104 11:24:29.362349  225909 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7687.pem

	I1104 11:24:29.365868  225909 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov  4 10:39 /usr/share/ca-certificates/7687.pem

	I1104 11:24:29.365944  225909 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7687.pem

	I1104 11:24:29.372897  225909 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7687.pem /etc/ssl/certs/51391683.0"

	I1104 11:24:29.382901  225909 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/76872.pem && ln -fs /usr/share/ca-certificates/76872.pem /etc/ssl/certs/76872.pem"

	I1104 11:24:29.392600  225909 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/76872.pem

	I1104 11:24:29.396397  225909 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov  4 10:39 /usr/share/ca-certificates/76872.pem

	I1104 11:24:29.396475  225909 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/76872.pem

	I1104 11:24:29.403641  225909 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/76872.pem /etc/ssl/certs/3ec20f2e.0"

	I1104 11:24:29.413613  225909 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1104 11:24:29.423251  225909 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1104 11:24:29.427014  225909 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov  4 10:31 /usr/share/ca-certificates/minikubeCA.pem

	I1104 11:24:29.427121  225909 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1104 11:24:29.434749  225909 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1104 11:24:29.444907  225909 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1104 11:24:29.448419  225909 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I1104 11:24:29.448473  225909 kubeadm.go:392] StartCluster: {Name:embed-certs-238832 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:embed-certs-238832 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe

rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fal

se CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1104 11:24:29.448593  225909 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}

	I1104 11:24:29.448668  225909 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I1104 11:24:29.499154  225909 cri.go:89] found id: ""

	I1104 11:24:29.499279  225909 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1104 11:24:29.508718  225909 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1104 11:24:29.518029  225909 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver

	I1104 11:24:29.518117  225909 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1104 11:24:29.527399  225909 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1104 11:24:29.527420  225909 kubeadm.go:157] found existing configuration files:

	I1104 11:24:29.527480  225909 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I1104 11:24:29.536561  225909 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I1104 11:24:29.536661  225909 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I1104 11:24:29.545752  225909 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I1104 11:24:29.554906  225909 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I1104 11:24:29.554987  225909 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I1104 11:24:29.563968  225909 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I1104 11:24:29.572884  225909 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I1104 11:24:29.572969  225909 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1104 11:24:29.584144  225909 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I1104 11:24:29.595346  225909 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I1104 11:24:29.595413  225909 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1104 11:24:29.606122  225909 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I1104 11:24:29.658569  225909 kubeadm.go:310] [init] Using Kubernetes version: v1.31.2

	I1104 11:24:29.658792  225909 kubeadm.go:310] [preflight] Running pre-flight checks

	I1104 11:24:29.678022  225909 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:

	I1104 11:24:29.678099  225909 kubeadm.go:310] KERNEL_VERSION: 5.15.0-1071-aws

	I1104 11:24:29.678142  225909 kubeadm.go:310] OS: Linux

	I1104 11:24:29.678191  225909 kubeadm.go:310] CGROUPS_CPU: enabled

	I1104 11:24:29.678243  225909 kubeadm.go:310] CGROUPS_CPUACCT: enabled

	I1104 11:24:29.678294  225909 kubeadm.go:310] CGROUPS_CPUSET: enabled

	I1104 11:24:29.678345  225909 kubeadm.go:310] CGROUPS_DEVICES: enabled

	I1104 11:24:29.678396  225909 kubeadm.go:310] CGROUPS_FREEZER: enabled

	I1104 11:24:29.678448  225909 kubeadm.go:310] CGROUPS_MEMORY: enabled

	I1104 11:24:29.678499  225909 kubeadm.go:310] CGROUPS_PIDS: enabled

	I1104 11:24:29.678595  225909 kubeadm.go:310] CGROUPS_HUGETLB: enabled

	I1104 11:24:29.678646  225909 kubeadm.go:310] CGROUPS_BLKIO: enabled

	I1104 11:24:29.742991  225909 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1104 11:24:29.743112  225909 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1104 11:24:29.743207  225909 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'

	I1104 11:24:29.749430  225909 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1104 11:24:31.929882  214454 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...

	I1104 11:24:31.943655  214454 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:

	ok

	I1104 11:24:31.947067  214454 out.go:201] 

	W1104 11:24:31.950694  214454 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0

	W1104 11:24:31.950914  214454 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge

	W1104 11:24:31.950982  214454 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417

	W1104 11:24:31.951015  214454 out.go:270] * 

	W1104 11:24:31.952131  214454 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I1104 11:24:31.954366  214454 out.go:201] 

	==> container status <==

	CONTAINER           IMAGE               CREATED             STATE               NAME                        ATTEMPT             POD ID              POD

	47867319efc88       523cad1a4df73       2 minutes ago       Exited              dashboard-metrics-scraper   5                   43b7e6cfae1d9       dashboard-metrics-scraper-8d5bb5db8-t4lfj

	c50257d1470aa       ba04bb24b9575       5 minutes ago       Running             storage-provisioner         2                   884ed94d929f9       storage-provisioner

	1796fcc40741b       20b332c9a70d8       5 minutes ago       Running             kubernetes-dashboard        0                   285a9e7b64cdd       kubernetes-dashboard-cd95d586-cmzn7

	6f46935ab57f3       25a5233254979       5 minutes ago       Running             kube-proxy                  1                   555b8b837e871       kube-proxy-nh94t

	c4409d354d043       db91994f4ee8f       5 minutes ago       Running             coredns                     1                   7c497a2760fff       coredns-74ff55c5b-g4hz8

	c97f229f53142       55b97e1cbb2a3       5 minutes ago       Running             kindnet-cni                 1                   a6fd9aec63231       kindnet-qtbb7

	796847166109e       ba04bb24b9575       5 minutes ago       Exited              storage-provisioner         1                   884ed94d929f9       storage-provisioner

	3b26e4500e78d       1611cd07b61d5       5 minutes ago       Running             busybox                     1                   a92150a4d9840       busybox

	a9495401d7754       e7605f88f17d6       6 minutes ago       Running             kube-scheduler              1                   fa91755f08873       kube-scheduler-old-k8s-version-500235

	35e17075a3193       1df8a2b116bd1       6 minutes ago       Running             kube-controller-manager     1                   3e79fdf79e763       kube-controller-manager-old-k8s-version-500235

	3e8112e77fc15       2c08bbbc02d3a       6 minutes ago       Running             kube-apiserver              1                   b897ca75a3cbb       kube-apiserver-old-k8s-version-500235

	264834df4b978       05b738aa1bc63       6 minutes ago       Running             etcd                        1                   b3716d8e5adfb       etcd-old-k8s-version-500235

	e594ddd4871e5       1611cd07b61d5       6 minutes ago       Exited              busybox                     0                   6d1d2f29fa5b8       busybox

	0eacea8f30c21       db91994f4ee8f       7 minutes ago       Exited              coredns                     0                   05dc5bb76a8c6       coredns-74ff55c5b-g4hz8

	55de0e155bc42       55b97e1cbb2a3       8 minutes ago       Exited              kindnet-cni                 0                   9aae3bb036935       kindnet-qtbb7

	e6255db4359d2       25a5233254979       8 minutes ago       Exited              kube-proxy                  0                   98f6bb847c6aa       kube-proxy-nh94t

	315609310246f       e7605f88f17d6       8 minutes ago       Exited              kube-scheduler              0                   2d0010f202f46       kube-scheduler-old-k8s-version-500235

	5fc8337da0345       1df8a2b116bd1       8 minutes ago       Exited              kube-controller-manager     0                   041a5d12fc811       kube-controller-manager-old-k8s-version-500235

	5f9f6f643b47c       05b738aa1bc63       8 minutes ago       Exited              etcd                        0                   d6b163001b22b       etcd-old-k8s-version-500235

	af8993ac19ddb       2c08bbbc02d3a       8 minutes ago       Exited              kube-apiserver              0                   9ddeb31b43792       kube-apiserver-old-k8s-version-500235

	==> containerd <==

	Nov 04 11:20:11 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:20:11.479521669Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain

	Nov 04 11:20:11 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:20:11.482227162Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	Nov 04 11:20:11 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:20:11.482329905Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"

	Nov 04 11:20:30 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:20:30.472861401Z" level=info msg="CreateContainer within sandbox \"43b7e6cfae1d943d1e9c6e496741f0c0735c782f830e5777d06c1cf82a01fca4\" for container name:\"dashboard-metrics-scraper\"  attempt:4"

	Nov 04 11:20:30 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:20:30.494439608Z" level=info msg="CreateContainer within sandbox \"43b7e6cfae1d943d1e9c6e496741f0c0735c782f830e5777d06c1cf82a01fca4\" for name:\"dashboard-metrics-scraper\"  attempt:4 returns container id \"34d350dc44bbcc1b46e2dd1416ac8ea1ead8a7fb9bf6e8dadbdcc993d28297e6\""

	Nov 04 11:20:30 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:20:30.495376234Z" level=info msg="StartContainer for \"34d350dc44bbcc1b46e2dd1416ac8ea1ead8a7fb9bf6e8dadbdcc993d28297e6\""

	Nov 04 11:20:30 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:20:30.573786783Z" level=info msg="StartContainer for \"34d350dc44bbcc1b46e2dd1416ac8ea1ead8a7fb9bf6e8dadbdcc993d28297e6\" returns successfully"

	Nov 04 11:20:30 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:20:30.604116020Z" level=info msg="shim disconnected" id=34d350dc44bbcc1b46e2dd1416ac8ea1ead8a7fb9bf6e8dadbdcc993d28297e6 namespace=k8s.io

	Nov 04 11:20:30 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:20:30.604173907Z" level=warning msg="cleaning up after shim disconnected" id=34d350dc44bbcc1b46e2dd1416ac8ea1ead8a7fb9bf6e8dadbdcc993d28297e6 namespace=k8s.io

	Nov 04 11:20:30 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:20:30.604186124Z" level=info msg="cleaning up dead shim" namespace=k8s.io

	Nov 04 11:20:31 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:20:31.192013445Z" level=info msg="RemoveContainer for \"43b9ea7dd9829974caf9577f3ff099aff78417ed6187cce6c445fa241c954d8b\""

	Nov 04 11:20:31 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:20:31.198878038Z" level=info msg="RemoveContainer for \"43b9ea7dd9829974caf9577f3ff099aff78417ed6187cce6c445fa241c954d8b\" returns successfully"

	Nov 04 11:21:43 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:21:43.471607091Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Nov 04 11:21:43 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:21:43.478274346Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host" host=fake.domain

	Nov 04 11:21:43 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:21:43.481328937Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.85.1:53: no such host"

	Nov 04 11:21:43 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:21:43.481390073Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"

	Nov 04 11:22:01 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:22:01.472619100Z" level=info msg="CreateContainer within sandbox \"43b7e6cfae1d943d1e9c6e496741f0c0735c782f830e5777d06c1cf82a01fca4\" for container name:\"dashboard-metrics-scraper\"  attempt:5"

	Nov 04 11:22:01 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:22:01.494086105Z" level=info msg="CreateContainer within sandbox \"43b7e6cfae1d943d1e9c6e496741f0c0735c782f830e5777d06c1cf82a01fca4\" for name:\"dashboard-metrics-scraper\"  attempt:5 returns container id \"47867319efc8892e032fd3a18b8acc0d9fc492d83af7bf6ae2b9b0d0b461824b\""

	Nov 04 11:22:01 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:22:01.494790612Z" level=info msg="StartContainer for \"47867319efc8892e032fd3a18b8acc0d9fc492d83af7bf6ae2b9b0d0b461824b\""

	Nov 04 11:22:01 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:22:01.562113356Z" level=info msg="StartContainer for \"47867319efc8892e032fd3a18b8acc0d9fc492d83af7bf6ae2b9b0d0b461824b\" returns successfully"

	Nov 04 11:22:01 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:22:01.585939382Z" level=info msg="shim disconnected" id=47867319efc8892e032fd3a18b8acc0d9fc492d83af7bf6ae2b9b0d0b461824b namespace=k8s.io

	Nov 04 11:22:01 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:22:01.586000173Z" level=warning msg="cleaning up after shim disconnected" id=47867319efc8892e032fd3a18b8acc0d9fc492d83af7bf6ae2b9b0d0b461824b namespace=k8s.io

	Nov 04 11:22:01 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:22:01.586011947Z" level=info msg="cleaning up dead shim" namespace=k8s.io

	Nov 04 11:22:02 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:22:02.455075700Z" level=info msg="RemoveContainer for \"34d350dc44bbcc1b46e2dd1416ac8ea1ead8a7fb9bf6e8dadbdcc993d28297e6\""

	Nov 04 11:22:02 old-k8s-version-500235 containerd[567]: time="2024-11-04T11:22:02.461194188Z" level=info msg="RemoveContainer for \"34d350dc44bbcc1b46e2dd1416ac8ea1ead8a7fb9bf6e8dadbdcc993d28297e6\" returns successfully"

	==> coredns [0eacea8f30c21c6e37db05c925c230cf081403ce010879dec3222a7e8391570a] <==

	.:53

	[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168

	CoreDNS-1.7.0

	linux/arm64, go1.14.4, f59c03d

	[INFO] 127.0.0.1:54121 - 18807 "HINFO IN 2917142269277337423.5003438419990683097. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.014388285s

	==> coredns [c4409d354d043fdd37e41a0d7a92c17c2c7e8581235a0a1e70b66f54f6ba08ad] <==

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	.:53

	[INFO] plugin/reload: Running configuration MD5 = 093a0bf1423dd8c4eee62372bb216168

	CoreDNS-1.7.0

	linux/arm64, go1.14.4, f59c03d

	[INFO] 127.0.0.1:49292 - 62481 "HINFO IN 9084143727429781435.2852756759546971913. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.015570314s

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	I1104 11:19:13.410217       1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-11-04 11:18:43.409837157 +0000 UTC m=+0.059235061) (total time: 30.000271799s):

	Trace[2019727887]: [30.000271799s] [30.000271799s] END

	I1104 11:19:13.411152       1 trace.go:116] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-11-04 11:18:43.409158833 +0000 UTC m=+0.058556745) (total time: 30.001969701s):

	Trace[1427131847]: [30.001969701s] [30.001969701s] END

	E1104 11:19:13.411172       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	E1104 11:19:13.411200       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	I1104 11:19:13.414496       1 trace.go:116] Trace[1474941318]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-11-04 11:18:43.41408442 +0000 UTC m=+0.063482332) (total time: 30.0003836s):

	Trace[1474941318]: [30.0003836s] [30.0003836s] END

	E1104 11:19:13.414794       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	==> describe nodes <==

	Name:               old-k8s-version-500235

	Roles:              control-plane,master

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=old-k8s-version-500235

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=c03dd974d73f8853a1a57928c124797a5ae24dc4

	                    minikube.k8s.io/name=old-k8s-version-500235

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_11_04T11_16_12_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node-role.kubernetes.io/master=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 04 Nov 2024 11:16:08 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  old-k8s-version-500235

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 04 Nov 2024 11:24:32 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 04 Nov 2024 11:24:32 +0000   Mon, 04 Nov 2024 11:16:01 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 04 Nov 2024 11:24:32 +0000   Mon, 04 Nov 2024 11:16:01 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 04 Nov 2024 11:24:32 +0000   Mon, 04 Nov 2024 11:16:01 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 04 Nov 2024 11:24:32 +0000   Mon, 04 Nov 2024 11:16:26 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.85.2

	  Hostname:    old-k8s-version-500235

	Capacity:

	  cpu:                2

	  ephemeral-storage:  203034800Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             8022300Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  203034800Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             8022300Ki

	  pods:               110

	System Info:

	  Machine ID:                 2c3b4386d16843718dcb60de096a67a6

	  System UUID:                ee598fa2-18c7-4a75-8af3-0384000b9e25

	  Boot ID:                    702105e3-4782-44ed-93fe-633f62cb3874

	  Kernel Version:             5.15.0-1071-aws

	  OS Image:                   Ubuntu 22.04.5 LTS

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  containerd://1.7.22

	  Kubelet Version:            v1.20.0

	  Kube-Proxy Version:         v1.20.0

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (12 in total)

	  Namespace                   Name                                              CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE

	  ---------                   ----                                              ------------  ----------  ---------------  -------------  ---

	  default                     busybox                                           0 (0%)        0 (0%)      0 (0%)           0 (0%)         6m48s

	  kube-system                 coredns-74ff55c5b-g4hz8                           100m (5%)     0 (0%)      70Mi (0%)        170Mi (2%)     8m8s

	  kube-system                 etcd-old-k8s-version-500235                       100m (5%)     0 (0%)      100Mi (1%)       0 (0%)         8m14s

	  kube-system                 kindnet-qtbb7                                     100m (5%)     100m (5%)   50Mi (0%)        50Mi (0%)      8m8s

	  kube-system                 kube-apiserver-old-k8s-version-500235             250m (12%)    0 (0%)      0 (0%)           0 (0%)         8m14s

	  kube-system                 kube-controller-manager-old-k8s-version-500235    200m (10%)    0 (0%)      0 (0%)           0 (0%)         8m14s

	  kube-system                 kube-proxy-nh94t                                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         8m8s

	  kube-system                 kube-scheduler-old-k8s-version-500235             100m (5%)     0 (0%)      0 (0%)           0 (0%)         8m14s

	  kube-system                 metrics-server-9975d5f86-qx7bx                    100m (5%)     0 (0%)      200Mi (2%)       0 (0%)         6m36s

	  kube-system                 storage-provisioner                               0 (0%)        0 (0%)      0 (0%)           0 (0%)         8m6s

	  kubernetes-dashboard        dashboard-metrics-scraper-8d5bb5db8-t4lfj         0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m36s

	  kubernetes-dashboard        kubernetes-dashboard-cd95d586-cmzn7               0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m36s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                950m (47%)  100m (5%)

	  memory             420Mi (5%)  220Mi (2%)

	  ephemeral-storage  100Mi (0%)  0 (0%)

	  hugepages-1Gi      0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	  hugepages-32Mi     0 (0%)      0 (0%)

	  hugepages-64Ki     0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                    From        Message

	  ----    ------                   ----                   ----        -------

	  Normal  NodeHasSufficientMemory  8m34s (x5 over 8m34s)  kubelet     Node old-k8s-version-500235 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    8m34s (x5 over 8m34s)  kubelet     Node old-k8s-version-500235 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     8m34s (x4 over 8m34s)  kubelet     Node old-k8s-version-500235 status is now: NodeHasSufficientPID

	  Normal  Starting                 8m15s                  kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  8m15s                  kubelet     Node old-k8s-version-500235 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    8m15s                  kubelet     Node old-k8s-version-500235 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     8m15s                  kubelet     Node old-k8s-version-500235 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  8m15s                  kubelet     Updated Node Allocatable limit across pods

	  Normal  NodeReady                8m8s                   kubelet     Node old-k8s-version-500235 status is now: NodeReady

	  Normal  Starting                 8m7s                   kube-proxy  Starting kube-proxy.

	  Normal  Starting                 6m7s                   kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  6m7s (x8 over 6m7s)    kubelet     Node old-k8s-version-500235 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m7s (x8 over 6m7s)    kubelet     Node old-k8s-version-500235 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m7s (x7 over 6m7s)    kubelet     Node old-k8s-version-500235 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  6m7s                   kubelet     Updated Node Allocatable limit across pods

	  Normal  Starting                 5m51s                  kube-proxy  Starting kube-proxy.

	==> dmesg <==

	[Nov 4 10:17] ACPI: SRAT not present

	[  +0.000000] ACPI: SRAT not present

	[  +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr

	[  +0.014529] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.

	[  +0.460963] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.

	[  +0.027494] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.

	[  +0.029696] systemd[1]: /lib/systemd/system/cloud-init.service:20: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.

	[  +0.017622] systemd[1]: /lib/systemd/system/cloud-init-hotplugd.socket:11: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.

	[  +0.766181] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.

	[  +6.352928] kauditd_printk_skb: 34 callbacks suppressed

	[Nov 4 10:41] 9pnet: p9_fd_create_tcp (44542): problem connecting socket to 192.168.49.1

	[Nov 4 10:42] FS-Cache: Duplicate cookie detected

	[  +0.000682] FS-Cache: O-cookie c=00000012 [p=00000002 fl=222 nc=0 na=1]

	[  +0.000899] FS-Cache: O-cookie d=000000008fc5edaa{9P.session} n=00000000039b211a

	[  +0.001016] FS-Cache: O-key=[10] '34323935323630343937'

	[  +0.000727] FS-Cache: N-cookie c=00000013 [p=00000002 fl=2 nc=0 na=1]

	[  +0.000880] FS-Cache: N-cookie d=000000008fc5edaa{9P.session} n=00000000e92f900f

	[  +0.001034] FS-Cache: N-key=[10] '34323935323630343937'

	[Nov 4 10:59] hrtimer: interrupt took 41037660 ns

	[Nov 4 11:08] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.

	==> etcd [264834df4b97845865803778632d50625eabbd66b2547ee289272493acd6170c] <==

	2024-11-04 11:20:25.307176 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:20:35.307048 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:20:45.307115 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:20:55.307050 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:21:05.307106 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:21:15.307000 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:21:25.307009 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:21:35.307185 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:21:45.307373 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:21:55.307013 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:22:05.307113 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:22:15.306919 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:22:25.307098 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:22:35.307008 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:22:45.307329 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:22:55.307050 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:23:05.307010 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:23:15.307046 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:23:25.306972 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:23:35.307823 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:23:45.308915 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:23:55.307062 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:24:05.307102 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:24:15.307133 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:24:25.307079 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	==> etcd [5f9f6f643b47c2d78af3cabb479505c7d022b211d718f21f9722f20f23462507] <==

	2024-11-04 11:16:01.605236 I | etcdserver/membership: added member 9f0758e1c58a86ed [https://192.168.85.2:2380] to cluster 68eaea490fab4e05

	raft2024/11/04 11:16:01 INFO: 9f0758e1c58a86ed is starting a new election at term 1

	raft2024/11/04 11:16:01 INFO: 9f0758e1c58a86ed became candidate at term 2

	raft2024/11/04 11:16:01 INFO: 9f0758e1c58a86ed received MsgVoteResp from 9f0758e1c58a86ed at term 2

	raft2024/11/04 11:16:01 INFO: 9f0758e1c58a86ed became leader at term 2

	raft2024/11/04 11:16:01 INFO: raft.node: 9f0758e1c58a86ed elected leader 9f0758e1c58a86ed at term 2

	2024-11-04 11:16:01.834732 I | etcdserver: published {Name:old-k8s-version-500235 ClientURLs:[https://192.168.85.2:2379]} to cluster 68eaea490fab4e05

	2024-11-04 11:16:01.834768 I | embed: ready to serve client requests

	2024-11-04 11:16:01.836199 I | embed: serving client requests on 192.168.85.2:2379

	2024-11-04 11:16:01.836443 I | etcdserver: setting up the initial cluster version to 3.4

	2024-11-04 11:16:01.836822 I | embed: ready to serve client requests

	2024-11-04 11:16:01.838088 I | embed: serving client requests on 127.0.0.1:2379

	2024-11-04 11:16:01.862862 N | etcdserver/membership: set the initial cluster version to 3.4

	2024-11-04 11:16:01.863160 I | etcdserver/api: enabled capabilities for version 3.4

	2024-11-04 11:16:22.052856 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:16:26.517971 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:16:36.509187 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:16:46.509216 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:16:56.509105 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:17:06.509270 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:17:16.509254 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:17:26.509249 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:17:36.509286 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:17:46.509197 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	2024-11-04 11:17:56.509374 I | etcdserver/api/etcdhttp: /health OK (status code 200)

	==> kernel <==

	 11:24:34 up  1:07,  0 users,  load average: 2.83, 2.25, 2.53

	Linux old-k8s-version-500235 5.15.0-1071-aws #77~20.04.1-Ubuntu SMP Thu Oct 3 19:34:36 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux

	PRETTY_NAME="Ubuntu 22.04.5 LTS"

	==> kindnet [55de0e155bc4227fa1a7b7fbfa0a89934a702ea6e0398a4160b6f36cd9f30f1d] <==

	I1104 11:16:29.631999       1 main.go:148] setting mtu 1500 for CNI 

	I1104 11:16:29.632023       1 main.go:178] kindnetd IP family: "ipv4"

	I1104 11:16:29.632089       1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]

	I1104 11:16:29.947571       1 controller.go:361] Starting controller kube-network-policies

	I1104 11:16:29.947779       1 controller.go:365] Waiting for informer caches to sync

	I1104 11:16:29.948060       1 shared_informer.go:313] Waiting for caches to sync for kube-network-policies

	I1104 11:16:30.048823       1 shared_informer.go:320] Caches are synced for kube-network-policies

	I1104 11:16:30.048885       1 metrics.go:61] Registering metrics

	I1104 11:16:30.048969       1 controller.go:401] Syncing nftables rules

	I1104 11:16:39.955631       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:16:39.955675       1 main.go:301] handling current node

	I1104 11:16:49.947836       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:16:49.947873       1 main.go:301] handling current node

	I1104 11:16:59.955231       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:16:59.955266       1 main.go:301] handling current node

	I1104 11:17:09.956643       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:17:09.956678       1 main.go:301] handling current node

	I1104 11:17:19.956011       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:17:19.956042       1 main.go:301] handling current node

	I1104 11:17:29.948083       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:17:29.948118       1 main.go:301] handling current node

	I1104 11:17:39.952009       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:17:39.952045       1 main.go:301] handling current node

	I1104 11:17:49.947790       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:17:49.947984       1 main.go:301] handling current node

	==> kindnet [c97f229f531420939c1e1384e49e4b9908698c727ac4354a27b3e19689dcc0bb] <==

	I1104 11:22:32.938801       1 main.go:301] handling current node

	I1104 11:22:42.931561       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:22:42.931601       1 main.go:301] handling current node

	I1104 11:22:52.938624       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:22:52.938659       1 main.go:301] handling current node

	I1104 11:23:02.931305       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:23:02.931347       1 main.go:301] handling current node

	I1104 11:23:12.938853       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:23:12.938893       1 main.go:301] handling current node

	I1104 11:23:22.930939       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:23:22.930980       1 main.go:301] handling current node

	I1104 11:23:32.938795       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:23:32.938857       1 main.go:301] handling current node

	I1104 11:23:42.931161       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:23:42.931397       1 main.go:301] handling current node

	I1104 11:23:52.938633       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:23:52.938665       1 main.go:301] handling current node

	I1104 11:24:02.939837       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:24:02.939953       1 main.go:301] handling current node

	I1104 11:24:12.938733       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:24:12.938772       1 main.go:301] handling current node

	I1104 11:24:22.938098       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:24:22.938136       1 main.go:301] handling current node

	I1104 11:24:32.938589       1 main.go:297] Handling node with IPs: map[192.168.85.2:{}]

	I1104 11:24:32.938627       1 main.go:301] handling current node

	==> kube-apiserver [3e8112e77fc159650cc821c6474494291af9e444ce6616d1a7b94efe6bbda6ab] <==

	I1104 11:21:12.978881       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I1104 11:21:12.978890       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	W1104 11:21:42.955784       1 handler_proxy.go:102] no RequestInfo found in the context

	E1104 11:21:42.955999       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	I1104 11:21:42.956015       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	I1104 11:21:45.009080       1 client.go:360] parsed scheme: "passthrough"

	I1104 11:21:45.009384       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I1104 11:21:45.009515       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I1104 11:22:16.108146       1 client.go:360] parsed scheme: "passthrough"

	I1104 11:22:16.108384       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I1104 11:22:16.108407       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I1104 11:22:53.301185       1 client.go:360] parsed scheme: "passthrough"

	I1104 11:22:53.301431       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I1104 11:22:53.301451       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I1104 11:23:37.424678       1 client.go:360] parsed scheme: "passthrough"

	I1104 11:23:37.424724       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I1104 11:23:37.424763       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	W1104 11:23:40.387312       1 handler_proxy.go:102] no RequestInfo found in the context

	E1104 11:23:40.387522       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	I1104 11:23:40.387539       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	I1104 11:24:18.760939       1 client.go:360] parsed scheme: "passthrough"

	I1104 11:24:18.760982       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I1104 11:24:18.760990       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	==> kube-apiserver [af8993ac19ddbf1c1b079010f12b22dd569c1d72a7170c14f6d752544c637c7c] <==

	I1104 11:16:08.194340       1 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller 

	I1104 11:16:08.205771       1 controller.go:606] quota admission added evaluator for: namespaces

	I1104 11:16:08.207329       1 shared_informer.go:247] Caches are synced for node_authorizer 

	I1104 11:16:08.975163       1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).

	I1104 11:16:08.975193       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

	I1104 11:16:08.982176       1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000

	I1104 11:16:08.985743       1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000

	I1104 11:16:08.985946       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.

	I1104 11:16:09.598048       1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I1104 11:16:09.647039       1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	W1104 11:16:09.753929       1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.85.2]

	I1104 11:16:09.755057       1 controller.go:606] quota admission added evaluator for: endpoints

	I1104 11:16:09.768834       1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I1104 11:16:10.600175       1 controller.go:606] quota admission added evaluator for: serviceaccounts

	I1104 11:16:11.222029       1 controller.go:606] quota admission added evaluator for: deployments.apps

	I1104 11:16:11.310235       1 controller.go:606] quota admission added evaluator for: daemonsets.apps

	I1104 11:16:19.673132       1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io

	I1104 11:16:26.579989       1 controller.go:606] quota admission added evaluator for: replicasets.apps

	I1104 11:16:26.722913       1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps

	I1104 11:16:43.953040       1 client.go:360] parsed scheme: "passthrough"

	I1104 11:16:43.953152       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I1104 11:16:43.953218       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	I1104 11:17:28.666827       1 client.go:360] parsed scheme: "passthrough"

	I1104 11:17:28.666875       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}

	I1104 11:17:28.666884       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

	==> kube-controller-manager [35e17075a3193e117833a30cd41003ad02a46f6e354b8efeb4e40a703b3cf693] <==

	E1104 11:20:30.329303       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1104 11:20:36.032063       1 request.go:655] Throttling request took 1.048442465s, request: GET:https://192.168.85.2:8443/apis/certificates.k8s.io/v1beta1?timeout=32s

	W1104 11:20:36.883696       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1104 11:21:00.843485       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1104 11:21:08.534219       1 request.go:655] Throttling request took 1.048114613s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s

	W1104 11:21:09.385746       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1104 11:21:31.345358       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1104 11:21:41.036383       1 request.go:655] Throttling request took 1.048481594s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1beta1?timeout=32s

	W1104 11:21:41.887834       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1104 11:22:01.847031       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1104 11:22:13.538202       1 request.go:655] Throttling request took 1.048463251s, request: GET:https://192.168.85.2:8443/apis/batch/v1beta1?timeout=32s

	W1104 11:22:14.389650       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1104 11:22:32.348878       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1104 11:22:46.040323       1 request.go:655] Throttling request took 1.048499411s, request: GET:https://192.168.85.2:8443/apis/authorization.k8s.io/v1?timeout=32s

	W1104 11:22:46.891641       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1104 11:23:02.850842       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1104 11:23:18.542157       1 request.go:655] Throttling request took 1.048541431s, request: GET:https://192.168.85.2:8443/apis/admissionregistration.k8s.io/v1beta1?timeout=32s

	W1104 11:23:19.400049       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1104 11:23:33.352657       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1104 11:23:51.050441       1 request.go:655] Throttling request took 1.04248677s, request: GET:https://192.168.85.2:8443/apis/extensions/v1beta1?timeout=32s

	W1104 11:23:51.901741       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1104 11:24:03.854721       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	I1104 11:24:23.552373       1 request.go:655] Throttling request took 1.048424166s, request: GET:https://192.168.85.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s

	W1104 11:24:24.403814       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E1104 11:24:34.359131       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	==> kube-controller-manager [5fc8337da03458cb82a696381c08decbec20e515a804b7d3039041c61f734ae0] <==

	I1104 11:16:26.703894       1 shared_informer.go:247] Caches are synced for node 

	I1104 11:16:26.704094       1 range_allocator.go:172] Starting range CIDR allocator

	I1104 11:16:26.704203       1 shared_informer.go:240] Waiting for caches to sync for cidrallocator

	I1104 11:16:26.704279       1 shared_informer.go:247] Caches are synced for cidrallocator 

	I1104 11:16:26.707241       1 shared_informer.go:247] Caches are synced for attach detach 

	I1104 11:16:26.708273       1 shared_informer.go:247] Caches are synced for daemon sets 

	I1104 11:16:26.720912       1 range_allocator.go:373] Set node old-k8s-version-500235 PodCIDR to [10.244.0.0/24]

	I1104 11:16:26.739488       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-qtbb7"

	I1104 11:16:26.739515       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-nh94t"

	I1104 11:16:26.758340       1 shared_informer.go:247] Caches are synced for PV protection 

	I1104 11:16:26.758707       1 shared_informer.go:247] Caches are synced for persistent volume 

	I1104 11:16:26.758857       1 shared_informer.go:247] Caches are synced for expand 

	I1104 11:16:26.768922       1 shared_informer.go:247] Caches are synced for resource quota 

	E1104 11:16:26.827833       1 daemon_controller.go:320] kube-system/kindnet failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kindnet", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"3ac93fe5-6066-4a4e-8c7d-f9360fd23439", ResourceVersion:"412", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63866315771, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"},\"name\":\"kindnet\",\"namespace\":\"kube-system\"},\"spec\":{\"selector\":{\"matchLabels\":{\"app\":\"k

indnet\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"}},\"spec\":{\"containers\":[{\"env\":[{\"name\":\"HOST_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.hostIP\"}}},{\"name\":\"POD_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}},{\"name\":\"POD_SUBNET\",\"value\":\"10.244.0.0/16\"}],\"image\":\"docker.io/kindest/kindnetd:v20241023-a345ebe4\",\"name\":\"kindnet-cni\",\"resources\":{\"limits\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"}},\"securityContext\":{\"capabilities\":{\"add\":[\"NET_RAW\",\"NET_ADMIN\"]},\"privileged\":false},\"volumeMounts\":[{\"mountPath\":\"/etc/cni/net.d\",\"name\":\"cni-cfg\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\",\"readOnly\":false},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\",\"readOnly\":true}]}],\"hostNetwork\":true,\"serviceAccountName\":\"kindnet\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\

":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/etc/cni/net.d\",\"type\":\"DirectoryOrCreate\"},\"name\":\"cni-cfg\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"}]}}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x40014c4c60), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x40014c4c80)}, v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x40014c4ca0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x40014c4cc0)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x40014c4ce0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generatio

n:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"cni-cfg", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40014c4d00), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:

(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40014c4d20), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlo

ckStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CS

I:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x40014c4d40), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Q

uobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kindnet-cni", Image:"docker.io/kindest/kindnetd:v20241023-a345ebe4", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOST_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x40014c4d60)}, v1.EnvVar{Name:"POD_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x40014c4da0)}, v1.EnvVar{Name:"POD_SUBNET", Value:"10.244.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"cpu":resource.Quantity{i

:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-cfg", ReadOnly:false, MountPath:"/etc/cni/net.d", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", Sub

Path:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x40013cf740), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x400172cec8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"kindnet", DeprecatedServiceAccount:"kindnet", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x400054e700), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinit

y:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x400000f2b8)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x400172cf10)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:1, NumberReady:0, ObservedGeneration:1, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:1, CollisionCount:(*int32)(nil), Conditions:[]v

1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kindnet": the object has been modified; please apply your changes to the latest version and try again

	I1104 11:16:26.923736       1 shared_informer.go:240] Waiting for caches to sync for garbage collector

	I1104 11:16:27.223879       1 shared_informer.go:247] Caches are synced for garbage collector 

	I1104 11:16:27.239558       1 shared_informer.go:247] Caches are synced for garbage collector 

	I1104 11:16:27.239581       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I1104 11:16:27.307946       1 shared_informer.go:240] Waiting for caches to sync for resource quota

	I1104 11:16:27.307990       1 shared_informer.go:247] Caches are synced for resource quota 

	I1104 11:16:28.180750       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"

	I1104 11:16:28.233505       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-8mgsm"

	I1104 11:16:31.660591       1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.

	I1104 11:17:57.827091       1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"

	E1104 11:17:57.959988       1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again

	==> kube-proxy [6f46935ab57f3ae4b043de0fbab5ec523c3e06cd43007d82aa078001cb601364] <==

	I1104 11:18:43.654848       1 node.go:172] Successfully retrieved node IP: 192.168.85.2

	I1104 11:18:43.655142       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation

	W1104 11:18:43.698485       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy

	I1104 11:18:43.698819       1 server_others.go:185] Using iptables Proxier.

	I1104 11:18:43.699167       1 server.go:650] Version: v1.20.0

	I1104 11:18:43.700433       1 config.go:315] Starting service config controller

	I1104 11:18:43.700602       1 shared_informer.go:240] Waiting for caches to sync for service config

	I1104 11:18:43.700701       1 config.go:224] Starting endpoint slice config controller

	I1104 11:18:43.700779       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I1104 11:18:43.800877       1 shared_informer.go:247] Caches are synced for service config 

	I1104 11:18:43.800951       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	==> kube-proxy [e6255db4359d2fc972f43b37d6434c4571e71ddfe5bd608725f16a5f12803e0e] <==

	I1104 11:16:27.626334       1 node.go:172] Successfully retrieved node IP: 192.168.85.2

	I1104 11:16:27.626418       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation

	W1104 11:16:27.663148       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy

	I1104 11:16:27.663244       1 server_others.go:185] Using iptables Proxier.

	I1104 11:16:27.663455       1 server.go:650] Version: v1.20.0

	I1104 11:16:27.664137       1 config.go:315] Starting service config controller

	I1104 11:16:27.664372       1 shared_informer.go:240] Waiting for caches to sync for service config

	I1104 11:16:27.670701       1 config.go:224] Starting endpoint slice config controller

	I1104 11:16:27.670720       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I1104 11:16:27.766162       1 shared_informer.go:247] Caches are synced for service config 

	I1104 11:16:27.770815       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	==> kube-scheduler [315609310246fb02d41baadc72115323d45bf3a159131f75ebbe409d29d740e3] <==

	W1104 11:16:08.126783       1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I1104 11:16:08.204477       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1104 11:16:08.204849       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1104 11:16:08.204819       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I1104 11:16:08.204839       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	E1104 11:16:08.214679       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1104 11:16:08.215264       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1104 11:16:08.215479       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1104 11:16:08.215559       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1104 11:16:08.215761       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E1104 11:16:08.215894       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1104 11:16:08.215990       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1104 11:16:08.216156       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E1104 11:16:08.216311       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1104 11:16:08.220084       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1104 11:16:08.220575       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1104 11:16:08.220831       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1104 11:16:09.027869       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1104 11:16:09.045279       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1104 11:16:09.088790       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E1104 11:16:09.152233       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1104 11:16:09.153653       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1104 11:16:09.171670       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1104 11:16:09.285297       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	I1104 11:16:10.905140       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	==> kube-scheduler [a9495401d77549271b083bfe15401b0ef6a02bcb677de2b829aed6f2a0fd9267] <==

	I1104 11:18:33.408469       1 serving.go:331] Generated self-signed cert in-memory

	W1104 11:18:39.419251       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W1104 11:18:39.419338       1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W1104 11:18:39.419365       1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.

	W1104 11:18:39.420839       1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I1104 11:18:39.663443       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

	I1104 11:18:39.664318       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1104 11:18:39.664374       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1104 11:18:39.664417       1 tlsconfig.go:240] Starting DynamicServingCertificateController

	I1104 11:18:39.870254       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	==> kubelet <==

	Nov 04 11:22:51 old-k8s-version-500235 kubelet[660]: E1104 11:22:51.470726     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	Nov 04 11:23:02 old-k8s-version-500235 kubelet[660]: E1104 11:23:02.470754     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Nov 04 11:23:03 old-k8s-version-500235 kubelet[660]: I1104 11:23:03.474367     660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 47867319efc8892e032fd3a18b8acc0d9fc492d83af7bf6ae2b9b0d0b461824b

	Nov 04 11:23:03 old-k8s-version-500235 kubelet[660]: E1104 11:23:03.474775     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	Nov 04 11:23:13 old-k8s-version-500235 kubelet[660]: E1104 11:23:13.471159     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Nov 04 11:23:18 old-k8s-version-500235 kubelet[660]: I1104 11:23:18.469786     660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 47867319efc8892e032fd3a18b8acc0d9fc492d83af7bf6ae2b9b0d0b461824b

	Nov 04 11:23:18 old-k8s-version-500235 kubelet[660]: E1104 11:23:18.470145     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	Nov 04 11:23:24 old-k8s-version-500235 kubelet[660]: E1104 11:23:24.470904     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Nov 04 11:23:32 old-k8s-version-500235 kubelet[660]: I1104 11:23:32.469968     660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 47867319efc8892e032fd3a18b8acc0d9fc492d83af7bf6ae2b9b0d0b461824b

	Nov 04 11:23:32 old-k8s-version-500235 kubelet[660]: E1104 11:23:32.470773     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	Nov 04 11:23:38 old-k8s-version-500235 kubelet[660]: E1104 11:23:38.470775     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Nov 04 11:23:44 old-k8s-version-500235 kubelet[660]: I1104 11:23:44.469884     660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 47867319efc8892e032fd3a18b8acc0d9fc492d83af7bf6ae2b9b0d0b461824b

	Nov 04 11:23:44 old-k8s-version-500235 kubelet[660]: E1104 11:23:44.470228     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	Nov 04 11:23:49 old-k8s-version-500235 kubelet[660]: E1104 11:23:49.471350     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Nov 04 11:23:57 old-k8s-version-500235 kubelet[660]: I1104 11:23:57.470369     660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 47867319efc8892e032fd3a18b8acc0d9fc492d83af7bf6ae2b9b0d0b461824b

	Nov 04 11:23:57 old-k8s-version-500235 kubelet[660]: E1104 11:23:57.471216     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	Nov 04 11:24:00 old-k8s-version-500235 kubelet[660]: E1104 11:24:00.472460     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Nov 04 11:24:11 old-k8s-version-500235 kubelet[660]: E1104 11:24:11.473454     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Nov 04 11:24:12 old-k8s-version-500235 kubelet[660]: I1104 11:24:12.469953     660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 47867319efc8892e032fd3a18b8acc0d9fc492d83af7bf6ae2b9b0d0b461824b

	Nov 04 11:24:12 old-k8s-version-500235 kubelet[660]: E1104 11:24:12.470610     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	Nov 04 11:24:22 old-k8s-version-500235 kubelet[660]: E1104 11:24:22.470851     660 pod_workers.go:191] Error syncing pod b6656306-4843-4a6d-ab5c-bba92b8d33fd ("metrics-server-9975d5f86-qx7bx_kube-system(b6656306-4843-4a6d-ab5c-bba92b8d33fd)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Nov 04 11:24:23 old-k8s-version-500235 kubelet[660]: I1104 11:24:23.470006     660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 47867319efc8892e032fd3a18b8acc0d9fc492d83af7bf6ae2b9b0d0b461824b

	Nov 04 11:24:23 old-k8s-version-500235 kubelet[660]: E1104 11:24:23.470392     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	Nov 04 11:24:34 old-k8s-version-500235 kubelet[660]: I1104 11:24:34.474700     660 scope.go:95] [topologymanager] RemoveContainer - Container ID: 47867319efc8892e032fd3a18b8acc0d9fc492d83af7bf6ae2b9b0d0b461824b

	Nov 04 11:24:34 old-k8s-version-500235 kubelet[660]: E1104 11:24:34.475104     660 pod_workers.go:191] Error syncing pod 1b757523-8268-4bd2-9260-d1cafe5e055a ("dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-t4lfj_kubernetes-dashboard(1b757523-8268-4bd2-9260-d1cafe5e055a)"

	==> kubernetes-dashboard [1796fcc40741bc21674b2d1e7ac63a200f8221893412d53b1a38dfee4597e57f] <==

	2024/11/04 11:19:08 Using namespace: kubernetes-dashboard

	2024/11/04 11:19:08 Using in-cluster config to connect to apiserver

	2024/11/04 11:19:08 Using secret token for csrf signing

	2024/11/04 11:19:08 Initializing csrf token from kubernetes-dashboard-csrf secret

	2024/11/04 11:19:08 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf

	2024/11/04 11:19:08 Successful initial request to the apiserver, version: v1.20.0

	2024/11/04 11:19:08 Generating JWE encryption key

	2024/11/04 11:19:08 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting

	2024/11/04 11:19:08 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard

	2024/11/04 11:19:08 Initializing JWE encryption key from synchronized object

	2024/11/04 11:19:08 Creating in-cluster Sidecar client

	2024/11/04 11:19:08 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/11/04 11:19:08 Serving insecurely on HTTP port: 9090

	2024/11/04 11:19:38 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/11/04 11:20:09 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/11/04 11:20:39 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/11/04 11:21:09 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/11/04 11:21:39 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/11/04 11:22:09 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/11/04 11:22:39 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/11/04 11:23:09 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/11/04 11:23:39 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/11/04 11:24:09 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2024/11/04 11:19:08 Starting overwatch

	==> storage-provisioner [796847166109e53e702d6b306fa9c019e4fc48de5cc9c8ae2b0dc01439739800] <==

	I1104 11:18:42.261754       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	F1104 11:19:12.264026       1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout

	==> storage-provisioner [c50257d1470aacd8de9da23f4d89da365c3a14a55f18a6a61447c58175cffb43] <==

	I1104 11:19:25.571405       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1104 11:19:25.585121       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1104 11:19:25.585353       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1104 11:19:43.082030       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1104 11:19:43.082247       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"2d21893c-9ac8-4f12-8aa3-59c680adc35f", APIVersion:"v1", ResourceVersion:"841", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-500235_95aa17a5-6936-4c0d-b4a0-15f8e6f5ad4b became leader

	I1104 11:19:43.084732       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-500235_95aa17a5-6936-4c0d-b4a0-15f8e6f5ad4b!

	I1104 11:19:43.185362       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-500235_95aa17a5-6936-4c0d-b4a0-15f8e6f5ad4b!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-500235 -n old-k8s-version-500235

helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-500235 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: metrics-server-9975d5f86-qx7bx

helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context old-k8s-version-500235 describe pod metrics-server-9975d5f86-qx7bx

helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-500235 describe pod metrics-server-9975d5f86-qx7bx: exit status 1 (134.801538ms)

** stderr ** 

	Error from server (NotFound): pods "metrics-server-9975d5f86-qx7bx" not found

** /stderr **

helpers_test.go:279: kubectl --context old-k8s-version-500235 describe pod metrics-server-9975d5f86-qx7bx: exit status 1

--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (385.38s)

=== RUN   TestDownloadOnly/v1.20.0/json-events

aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-799906 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd

aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-799906 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (6.627131904s)

--- PASS: TestDownloadOnly/v1.20.0/json-events (6.63s)

=== RUN   TestDownloadOnly/v1.20.0/preload-exists

I1104 10:30:48.557457    7687 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd

I1104 10:30:48.557534    7687 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19906-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4

--- PASS: TestDownloadOnly/v1.20.0/preload-exists (0.00s)

=== RUN   TestDownloadOnly/v1.20.0/LogsDuration

aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-799906

aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-799906: exit status 85 (76.558405ms)

-- stdout --

	==> Audit <==

	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|

	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|

	| start   | -o=json --download-only        | download-only-799906 | jenkins | v1.34.0 | 04 Nov 24 10:30 UTC |          |

	|         | -p download-only-799906        |                      |         |         |                     |          |

	|         | --force --alsologtostderr      |                      |         |         |                     |          |

	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |          |

	|         | --container-runtime=containerd |                      |         |         |                     |          |

	|         | --driver=docker                |                      |         |         |                     |          |

	|         | --container-runtime=containerd |                      |         |         |                     |          |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|

	==> Last Start <==

	Log file created at: 2024/11/04 10:30:41

	Running on machine: ip-172-31-24-2

	Binary: Built with gc go1.23.2 for linux/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1104 10:30:41.982982    7693 out.go:345] Setting OutFile to fd 1 ...

	I1104 10:30:41.983184    7693 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1104 10:30:41.983213    7693 out.go:358] Setting ErrFile to fd 2...

	I1104 10:30:41.983232    7693 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1104 10:30:41.983491    7693 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19906-2243/.minikube/bin

	W1104 10:30:41.983647    7693 root.go:314] Error reading config file at /home/jenkins/minikube-integration/19906-2243/.minikube/config/config.json: open /home/jenkins/minikube-integration/19906-2243/.minikube/config/config.json: no such file or directory

	I1104 10:30:41.984072    7693 out.go:352] Setting JSON to true

	I1104 10:30:41.984858    7693 start.go:129] hostinfo: {"hostname":"ip-172-31-24-2","uptime":793,"bootTime":1730715449,"procs":149,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"6d436adf-771e-4269-b9a3-c25fd4fca4f5"}

	I1104 10:30:41.984957    7693 start.go:139] virtualization:  

	I1104 10:30:41.988328    7693 out.go:97] [download-only-799906] minikube v1.34.0 on Ubuntu 20.04 (arm64)

	W1104 10:30:41.988495    7693 preload.go:293] Failed to list preload files: open /home/jenkins/minikube-integration/19906-2243/.minikube/cache/preloaded-tarball: no such file or directory

	I1104 10:30:41.988543    7693 notify.go:220] Checking for updates...

	I1104 10:30:41.990876    7693 out.go:169] MINIKUBE_LOCATION=19906

	I1104 10:30:41.992831    7693 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1104 10:30:41.995053    7693 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19906-2243/kubeconfig

	I1104 10:30:41.997390    7693 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19906-2243/.minikube

	I1104 10:30:41.999444    7693 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64

	W1104 10:30:42.016153    7693 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I1104 10:30:42.016499    7693 driver.go:394] Setting default libvirt URI to qemu:///system

	I1104 10:30:42.049648    7693 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community

	I1104 10:30:42.049755    7693 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1104 10:30:42.463237    7693 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:52 SystemTime:2024-11-04 10:30:42.453271477 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a

arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge

-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}

	I1104 10:30:42.463349    7693 docker.go:318] overlay module found

	I1104 10:30:42.465711    7693 out.go:97] Using the docker driver based on user configuration

	I1104 10:30:42.465746    7693 start.go:297] selected driver: docker

	I1104 10:30:42.465753    7693 start.go:901] validating driver "docker" against <nil>

	I1104 10:30:42.465849    7693 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1104 10:30:42.516460    7693 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:52 SystemTime:2024-11-04 10:30:42.507439221 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a

arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge

-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}

	I1104 10:30:42.516665    7693 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1104 10:30:42.516951    7693 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB

	I1104 10:30:42.517122    7693 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I1104 10:30:42.519471    7693 out.go:169] Using Docker driver with root privileges

	I1104 10:30:42.521628    7693 cni.go:84] Creating CNI manager for ""

	I1104 10:30:42.521693    7693 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet

	I1104 10:30:42.521716    7693 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I1104 10:30:42.521803    7693 start.go:340] cluster config:

	{Name:download-only-799906 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-799906 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co

ntainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1104 10:30:42.523765    7693 out.go:97] Starting "download-only-799906" primary control-plane node in "download-only-799906" cluster

	I1104 10:30:42.523787    7693 cache.go:121] Beginning downloading kic base image for docker with containerd

	I1104 10:30:42.525630    7693 out.go:97] Pulling base image v0.0.45-1730282848-19883 ...

	I1104 10:30:42.525657    7693 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd

	I1104 10:30:42.525804    7693 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 in local docker daemon

	I1104 10:30:42.541127    7693 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 to local cache

	I1104 10:30:42.541295    7693 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 in local cache directory

	I1104 10:30:42.541388    7693 image.go:148] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 to local cache

	I1104 10:30:42.586059    7693 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4

	I1104 10:30:42.586092    7693 cache.go:56] Caching tarball of preloaded images

	I1104 10:30:42.586222    7693 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd

	I1104 10:30:42.588720    7693 out.go:97] Downloading Kubernetes v1.20.0 preload ...

	I1104 10:30:42.588751    7693 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 ...

	I1104 10:30:42.675733    7693 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4?checksum=md5:7e3d48ccb9f143791669d02e14ce1643 -> /home/jenkins/minikube-integration/19906-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4

	I1104 10:30:46.935051    7693 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 ...

	I1104 10:30:46.935167    7693 preload.go:254] verifying checksum of /home/jenkins/minikube-integration/19906-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 ...

	* The control-plane node download-only-799906 host does not exist

	  To start a cluster, run: "minikube start -p download-only-799906"

-- /stdout --

aaa_download_only_test.go:185: minikube logs failed with error: exit status 85

--- PASS: TestDownloadOnly/v1.20.0/LogsDuration (0.08s)

=== RUN   TestDownloadOnly/v1.20.0/DeleteAll

aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all

--- PASS: TestDownloadOnly/v1.20.0/DeleteAll (0.21s)

=== RUN   TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds

aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-799906

--- PASS: TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.14s)

=== RUN   TestDownloadOnly/v1.31.2/json-events

aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-709307 --force --alsologtostderr --kubernetes-version=v1.31.2 --container-runtime=containerd --driver=docker  --container-runtime=containerd

aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-709307 --force --alsologtostderr --kubernetes-version=v1.31.2 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (5.221331382s)

--- PASS: TestDownloadOnly/v1.31.2/json-events (5.22s)

=== RUN   TestDownloadOnly/v1.31.2/preload-exists

I1104 10:30:54.207356    7687 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime containerd

I1104 10:30:54.207396    7687 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19906-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4

--- PASS: TestDownloadOnly/v1.31.2/preload-exists (0.00s)

=== RUN   TestDownloadOnly/v1.31.2/LogsDuration

aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-709307

aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-709307: exit status 85 (77.603485ms)

-- stdout --

	==> Audit <==

	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only        | download-only-799906 | jenkins | v1.34.0 | 04 Nov 24 10:30 UTC |                     |

	|         | -p download-only-799906        |                      |         |         |                     |                     |

	|         | --force --alsologtostderr      |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |                     |

	|         | --container-runtime=containerd |                      |         |         |                     |                     |

	|         | --driver=docker                |                      |         |         |                     |                     |

	|         | --container-runtime=containerd |                      |         |         |                     |                     |

	| delete  | --all                          | minikube             | jenkins | v1.34.0 | 04 Nov 24 10:30 UTC | 04 Nov 24 10:30 UTC |

	| delete  | -p download-only-799906        | download-only-799906 | jenkins | v1.34.0 | 04 Nov 24 10:30 UTC | 04 Nov 24 10:30 UTC |

	| start   | -o=json --download-only        | download-only-709307 | jenkins | v1.34.0 | 04 Nov 24 10:30 UTC |                     |

	|         | -p download-only-709307        |                      |         |         |                     |                     |

	|         | --force --alsologtostderr      |                      |         |         |                     |                     |

	|         | --kubernetes-version=v1.31.2   |                      |         |         |                     |                     |

	|         | --container-runtime=containerd |                      |         |         |                     |                     |

	|         | --driver=docker                |                      |         |         |                     |                     |

	|         | --container-runtime=containerd |                      |         |         |                     |                     |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/11/04 10:30:49

	Running on machine: ip-172-31-24-2

	Binary: Built with gc go1.23.2 for linux/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1104 10:30:49.034327    7891 out.go:345] Setting OutFile to fd 1 ...

	I1104 10:30:49.034499    7891 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1104 10:30:49.034540    7891 out.go:358] Setting ErrFile to fd 2...

	I1104 10:30:49.034563    7891 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1104 10:30:49.034823    7891 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19906-2243/.minikube/bin

	I1104 10:30:49.035290    7891 out.go:352] Setting JSON to true

	I1104 10:30:49.036091    7891 start.go:129] hostinfo: {"hostname":"ip-172-31-24-2","uptime":800,"bootTime":1730715449,"procs":147,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"6d436adf-771e-4269-b9a3-c25fd4fca4f5"}

	I1104 10:30:49.036166    7891 start.go:139] virtualization:  

	I1104 10:30:49.038833    7891 out.go:97] [download-only-709307] minikube v1.34.0 on Ubuntu 20.04 (arm64)

	I1104 10:30:49.039069    7891 notify.go:220] Checking for updates...

	I1104 10:30:49.041782    7891 out.go:169] MINIKUBE_LOCATION=19906

	I1104 10:30:49.044036    7891 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1104 10:30:49.046357    7891 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19906-2243/kubeconfig

	I1104 10:30:49.048505    7891 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19906-2243/.minikube

	I1104 10:30:49.050603    7891 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64

	W1104 10:30:49.055456    7891 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I1104 10:30:49.055735    7891 driver.go:394] Setting default libvirt URI to qemu:///system

	I1104 10:30:49.080303    7891 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community

	I1104 10:30:49.080414    7891 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1104 10:30:49.143114    7891 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:45 SystemTime:2024-11-04 10:30:49.13328354 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aa

rch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge-

nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}

	I1104 10:30:49.143243    7891 docker.go:318] overlay module found

	I1104 10:30:49.146107    7891 out.go:97] Using the docker driver based on user configuration

	I1104 10:30:49.146137    7891 start.go:297] selected driver: docker

	I1104 10:30:49.146143    7891 start.go:901] validating driver "docker" against <nil>

	I1104 10:30:49.146246    7891 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1104 10:30:49.210437    7891 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:45 SystemTime:2024-11-04 10:30:49.200994805 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a

arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge

-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}

	I1104 10:30:49.210714    7891 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1104 10:30:49.210997    7891 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB

	I1104 10:30:49.211164    7891 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]

	I1104 10:30:49.213632    7891 out.go:169] Using Docker driver with root privileges

	I1104 10:30:49.215521    7891 cni.go:84] Creating CNI manager for ""

	I1104 10:30:49.215588    7891 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet

	I1104 10:30:49.215602    7891 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I1104 10:30:49.215687    7891 start.go:340] cluster config:

	{Name:download-only-709307 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:download-only-709307 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co

ntainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1104 10:30:49.217955    7891 out.go:97] Starting "download-only-709307" primary control-plane node in "download-only-709307" cluster

	I1104 10:30:49.217973    7891 cache.go:121] Beginning downloading kic base image for docker with containerd

	I1104 10:30:49.219915    7891 out.go:97] Pulling base image v0.0.45-1730282848-19883 ...

	I1104 10:30:49.219941    7891 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime containerd

	I1104 10:30:49.220110    7891 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 in local docker daemon

	I1104 10:30:49.234913    7891 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 to local cache

	I1104 10:30:49.235042    7891 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 in local cache directory

	I1104 10:30:49.235063    7891 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 in local cache directory, skipping pull

	I1104 10:30:49.235068    7891 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 exists in cache, skipping pull

	I1104 10:30:49.235075    7891 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 as a tarball

	I1104 10:30:49.288132    7891 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.2/preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4

	I1104 10:30:49.288159    7891 cache.go:56] Caching tarball of preloaded images

	I1104 10:30:49.288293    7891 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime containerd

	I1104 10:30:49.291140    7891 out.go:97] Downloading Kubernetes v1.31.2 preload ...

	I1104 10:30:49.291190    7891 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4 ...

	I1104 10:30:49.382205    7891 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.2/preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4?checksum=md5:5a1c96cd03f848c5b0e8fb66f315acd5 -> /home/jenkins/minikube-integration/19906-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4

	I1104 10:30:52.704995    7891 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4 ...

	I1104 10:30:52.705181    7891 preload.go:254] verifying checksum of /home/jenkins/minikube-integration/19906-2243/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4 ...

	I1104 10:30:53.584887    7891 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on containerd

	I1104 10:30:53.585263    7891 profile.go:143] Saving config to /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/download-only-709307/config.json ...

	I1104 10:30:53.585296    7891 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/download-only-709307/config.json: {Name:mkb2c376a038f5bd13ce8cf50715f02efc9a64f5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1104 10:30:53.585483    7891 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime containerd

	I1104 10:30:53.585629    7891 download.go:107] Downloading: https://dl.k8s.io/release/v1.31.2/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/arm64/kubectl.sha256 -> /home/jenkins/minikube-integration/19906-2243/.minikube/cache/linux/arm64/v1.31.2/kubectl

	* The control-plane node download-only-709307 host does not exist

	  To start a cluster, run: "minikube start -p download-only-709307"

-- /stdout --

aaa_download_only_test.go:185: minikube logs failed with error: exit status 85

--- PASS: TestDownloadOnly/v1.31.2/LogsDuration (0.08s)

=== RUN   TestDownloadOnly/v1.31.2/DeleteAll

aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all

--- PASS: TestDownloadOnly/v1.31.2/DeleteAll (0.21s)

=== RUN   TestDownloadOnly/v1.31.2/DeleteAlwaysSucceeds

aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-709307

--- PASS: TestDownloadOnly/v1.31.2/DeleteAlwaysSucceeds (0.13s)

=== RUN   TestBinaryMirror

I1104 10:30:55.486792    7687 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/arm64/kubectl.sha256

aaa_download_only_test.go:314: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-292560 --alsologtostderr --binary-mirror http://127.0.0.1:36529 --driver=docker  --container-runtime=containerd

helpers_test.go:175: Cleaning up "binary-mirror-292560" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-292560

--- PASS: TestBinaryMirror (0.56s)

=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

addons_test.go:939: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-377355

addons_test.go:939: (dbg) Non-zero exit: out/minikube-linux-arm64 addons enable dashboard -p addons-377355: exit status 85 (79.520801ms)

-- stdout --

	* Profile "addons-377355" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p addons-377355"

-- /stdout --

--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.08s)

=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

addons_test.go:950: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-377355

addons_test.go:950: (dbg) Non-zero exit: out/minikube-linux-arm64 addons disable dashboard -p addons-377355: exit status 85 (70.515044ms)

-- stdout --

	* Profile "addons-377355" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p addons-377355"

-- /stdout --

--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.07s)

=== RUN   TestAddons/Setup

addons_test.go:107: (dbg) Run:  out/minikube-linux-arm64 start -p addons-377355 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher

addons_test.go:107: (dbg) Done: out/minikube-linux-arm64 start -p addons-377355 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher: (3m35.755221856s)

--- PASS: TestAddons/Setup (215.76s)

=== RUN   TestAddons/serial/Volcano

addons_test.go:815: volcano-admission stabilized in 63.063587ms

addons_test.go:807: volcano-scheduler stabilized in 65.067599ms

addons_test.go:823: volcano-controller stabilized in 66.302098ms

addons_test.go:829: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...

helpers_test.go:344: "volcano-scheduler-6c9778cbdf-6cqth" [936f2e16-746a-4298-9920-697b7b85af0d] Running

addons_test.go:829: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.003964442s

addons_test.go:833: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...

helpers_test.go:344: "volcano-admission-5874dfdd79-tgndt" [d63ec412-b1e2-4aa1-9d99-dd4a014c9445] Running

addons_test.go:833: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 6.003627265s

addons_test.go:837: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...

helpers_test.go:344: "volcano-controllers-789ffc5785-drcw6" [a3d7abaf-a008-4e1d-9e75-ebf3d4bd56e6] Running

addons_test.go:837: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.003781519s

addons_test.go:842: (dbg) Run:  kubectl --context addons-377355 delete -n volcano-system job volcano-admission-init

addons_test.go:848: (dbg) Run:  kubectl --context addons-377355 create -f testdata/vcjob.yaml

addons_test.go:856: (dbg) Run:  kubectl --context addons-377355 get vcjob -n my-volcano

addons_test.go:874: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...

helpers_test.go:344: "test-job-nginx-0" [fe2ef13e-2895-43bb-9886-043b2ed83029] Pending

helpers_test.go:344: "test-job-nginx-0" [fe2ef13e-2895-43bb-9886-043b2ed83029] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

helpers_test.go:344: "test-job-nginx-0" [fe2ef13e-2895-43bb-9886-043b2ed83029] Running

addons_test.go:874: (dbg) TestAddons/serial/Volcano: volcano.sh/job-name=test-job healthy within 12.003401252s

addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 addons disable volcano --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-377355 addons disable volcano --alsologtostderr -v=1: (11.249400175s)

--- PASS: TestAddons/serial/Volcano (40.93s)

=== RUN   TestAddons/serial/GCPAuth/Namespaces

addons_test.go:569: (dbg) Run:  kubectl --context addons-377355 create ns new-namespace

addons_test.go:583: (dbg) Run:  kubectl --context addons-377355 get secret gcp-auth -n new-namespace

--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.19s)

=== RUN   TestAddons/serial/GCPAuth/FakeCredentials

addons_test.go:614: (dbg) Run:  kubectl --context addons-377355 create -f testdata/busybox.yaml

addons_test.go:621: (dbg) Run:  kubectl --context addons-377355 create sa gcp-auth-test

addons_test.go:627: (dbg) TestAddons/serial/GCPAuth/FakeCredentials: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...

helpers_test.go:344: "busybox" [dfcb60ec-dd49-4d40-a8dd-f6081d450085] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

helpers_test.go:344: "busybox" [dfcb60ec-dd49-4d40-a8dd-f6081d450085] Running

addons_test.go:627: (dbg) TestAddons/serial/GCPAuth/FakeCredentials: integration-test=busybox healthy within 9.004182993s

addons_test.go:633: (dbg) Run:  kubectl --context addons-377355 exec busybox -- /bin/sh -c "printenv GOOGLE_APPLICATION_CREDENTIALS"

addons_test.go:645: (dbg) Run:  kubectl --context addons-377355 describe sa gcp-auth-test

addons_test.go:659: (dbg) Run:  kubectl --context addons-377355 exec busybox -- /bin/sh -c "cat /google-app-creds.json"

addons_test.go:683: (dbg) Run:  kubectl --context addons-377355 exec busybox -- /bin/sh -c "printenv GOOGLE_CLOUD_PROJECT"

--- PASS: TestAddons/serial/GCPAuth/FakeCredentials (9.93s)

=== RUN   TestAddons/parallel/Registry

=== PAUSE TestAddons/parallel/Registry

=== CONT  TestAddons/parallel/Registry

addons_test.go:321: registry stabilized in 5.460607ms

addons_test.go:323: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...

helpers_test.go:344: "registry-66c9cd494c-2ng66" [8283accb-acc1-4e71-9546-dccb81d7f7e9] Running

addons_test.go:323: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.018353597s

addons_test.go:326: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...

helpers_test.go:344: "registry-proxy-hsxc9" [e6da2abe-4d56-41fe-9a08-0737d883a149] Running

addons_test.go:326: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.007138811s

addons_test.go:331: (dbg) Run:  kubectl --context addons-377355 delete po -l run=registry-test --now

addons_test.go:336: (dbg) Run:  kubectl --context addons-377355 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"

addons_test.go:336: (dbg) Done: kubectl --context addons-377355 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (4.674395708s)

addons_test.go:350: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 ip

2024/11/04 10:35:46 [DEBUG] GET http://192.168.49.2:5000

addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 addons disable registry --alsologtostderr -v=1

--- PASS: TestAddons/parallel/Registry (15.73s)

=== RUN   TestAddons/parallel/Ingress

=== PAUSE TestAddons/parallel/Ingress

=== CONT  TestAddons/parallel/Ingress

addons_test.go:207: (dbg) Run:  kubectl --context addons-377355 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s

addons_test.go:232: (dbg) Run:  kubectl --context addons-377355 replace --force -f testdata/nginx-ingress-v1.yaml

addons_test.go:245: (dbg) Run:  kubectl --context addons-377355 replace --force -f testdata/nginx-pod-svc.yaml

addons_test.go:250: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...

helpers_test.go:344: "nginx" [495c21b7-9bff-422e-b464-aec360e073c0] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

helpers_test.go:344: "nginx" [495c21b7-9bff-422e-b464-aec360e073c0] Running

addons_test.go:250: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 8.003754721s

I1104 10:37:07.262270    7687 kapi.go:150] Service nginx in namespace default found.

addons_test.go:262: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"

addons_test.go:286: (dbg) Run:  kubectl --context addons-377355 replace --force -f testdata/ingress-dns-example-v1.yaml

addons_test.go:291: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 ip

addons_test.go:297: (dbg) Run:  nslookup hello-john.test 192.168.49.2

addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 addons disable ingress-dns --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-377355 addons disable ingress-dns --alsologtostderr -v=1: (1.798723537s)

addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 addons disable ingress --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-377355 addons disable ingress --alsologtostderr -v=1: (7.755516771s)

--- PASS: TestAddons/parallel/Ingress (19.33s)

=== RUN   TestAddons/parallel/InspektorGadget

=== PAUSE TestAddons/parallel/InspektorGadget

=== CONT  TestAddons/parallel/InspektorGadget

addons_test.go:762: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...

helpers_test.go:344: "gadget-zgl9r" [76308f86-4115-4a17-a9f5-b277f70865b4] Running

addons_test.go:762: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 6.004646164s

addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 addons disable inspektor-gadget --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-377355 addons disable inspektor-gadget --alsologtostderr -v=1: (5.869224139s)

--- PASS: TestAddons/parallel/InspektorGadget (11.88s)

=== RUN   TestAddons/parallel/MetricsServer

=== PAUSE TestAddons/parallel/MetricsServer

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:394: metrics-server stabilized in 3.606516ms

addons_test.go:396: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...

helpers_test.go:344: "metrics-server-84c5f94fbc-qz945" [9cae239e-8680-426f-a961-cbe36dd3dc08] Running

addons_test.go:396: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.005591086s

addons_test.go:402: (dbg) Run:  kubectl --context addons-377355 top pods -n kube-system

addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 addons disable metrics-server --alsologtostderr -v=1

--- PASS: TestAddons/parallel/MetricsServer (5.82s)

=== RUN   TestAddons/parallel/CSI

=== PAUSE TestAddons/parallel/CSI

=== CONT  TestAddons/parallel/CSI

I1104 10:36:12.347380    7687 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

I1104 10:36:12.352429    7687 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

I1104 10:36:12.352465    7687 kapi.go:107] duration metric: took 8.903909ms to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

addons_test.go:488: csi-hostpath-driver pods stabilized in 8.916176ms

addons_test.go:491: (dbg) Run:  kubectl --context addons-377355 create -f testdata/csi-hostpath-driver/pvc.yaml

addons_test.go:496: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc -o jsonpath={.status.phase} -n default

addons_test.go:501: (dbg) Run:  kubectl --context addons-377355 create -f testdata/csi-hostpath-driver/pv-pod.yaml

addons_test.go:506: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...

helpers_test.go:344: "task-pv-pod" [68d45190-eb63-48d3-a6da-be8040cd8da5] Pending

helpers_test.go:344: "task-pv-pod" [68d45190-eb63-48d3-a6da-be8040cd8da5] Running

addons_test.go:506: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 7.003396226s

addons_test.go:511: (dbg) Run:  kubectl --context addons-377355 create -f testdata/csi-hostpath-driver/snapshot.yaml

addons_test.go:516: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...

helpers_test.go:419: (dbg) Run:  kubectl --context addons-377355 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default

helpers_test.go:419: (dbg) Run:  kubectl --context addons-377355 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default

addons_test.go:521: (dbg) Run:  kubectl --context addons-377355 delete pod task-pv-pod

addons_test.go:527: (dbg) Run:  kubectl --context addons-377355 delete pvc hpvc

addons_test.go:533: (dbg) Run:  kubectl --context addons-377355 create -f testdata/csi-hostpath-driver/pvc-restore.yaml

addons_test.go:538: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

addons_test.go:543: (dbg) Run:  kubectl --context addons-377355 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml

addons_test.go:548: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...

helpers_test.go:344: "task-pv-pod-restore" [f3784a15-0eb7-4c6a-a218-a23dc3909f69] Pending

helpers_test.go:344: "task-pv-pod-restore" [f3784a15-0eb7-4c6a-a218-a23dc3909f69] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

helpers_test.go:344: "task-pv-pod-restore" [f3784a15-0eb7-4c6a-a218-a23dc3909f69] Running

addons_test.go:548: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.027190191s

addons_test.go:553: (dbg) Run:  kubectl --context addons-377355 delete pod task-pv-pod-restore

addons_test.go:553: (dbg) Done: kubectl --context addons-377355 delete pod task-pv-pod-restore: (1.413136825s)

addons_test.go:557: (dbg) Run:  kubectl --context addons-377355 delete pvc hpvc-restore

addons_test.go:561: (dbg) Run:  kubectl --context addons-377355 delete volumesnapshot new-snapshot-demo

addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 addons disable volumesnapshots --alsologtostderr -v=1

addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 addons disable csi-hostpath-driver --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-377355 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.917150825s)

--- PASS: TestAddons/parallel/CSI (56.07s)

=== RUN   TestAddons/parallel/Headlamp

=== PAUSE TestAddons/parallel/Headlamp

=== CONT  TestAddons/parallel/Headlamp

addons_test.go:747: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-377355 --alsologtostderr -v=1

addons_test.go:747: (dbg) Done: out/minikube-linux-arm64 addons enable headlamp -p addons-377355 --alsologtostderr -v=1: (1.148102435s)

addons_test.go:752: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...

helpers_test.go:344: "headlamp-7b5c95b59d-wkqwt" [5b292fff-b0c7-4ba6-a721-e9623bf8eb7a] Pending

helpers_test.go:344: "headlamp-7b5c95b59d-wkqwt" [5b292fff-b0c7-4ba6-a721-e9623bf8eb7a] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])

helpers_test.go:344: "headlamp-7b5c95b59d-wkqwt" [5b292fff-b0c7-4ba6-a721-e9623bf8eb7a] Running

addons_test.go:752: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 10.004092367s

addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 addons disable headlamp --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-377355 addons disable headlamp --alsologtostderr -v=1: (5.791079919s)

--- PASS: TestAddons/parallel/Headlamp (16.95s)

=== RUN   TestAddons/parallel/CloudSpanner

=== PAUSE TestAddons/parallel/CloudSpanner

=== CONT  TestAddons/parallel/CloudSpanner

addons_test.go:779: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...

helpers_test.go:344: "cloud-spanner-emulator-dc5db94f4-9xk9l" [dd71d5b8-49dd-4210-ae46-7324d58e2486] Running

addons_test.go:779: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 6.004167516s

addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 addons disable cloud-spanner --alsologtostderr -v=1

--- PASS: TestAddons/parallel/CloudSpanner (6.61s)

=== RUN   TestAddons/parallel/LocalPath

=== PAUSE TestAddons/parallel/LocalPath

=== CONT  TestAddons/parallel/LocalPath

addons_test.go:888: (dbg) Run:  kubectl --context addons-377355 apply -f testdata/storage-provisioner-rancher/pvc.yaml

addons_test.go:894: (dbg) Run:  kubectl --context addons-377355 apply -f testdata/storage-provisioner-rancher/pod.yaml

addons_test.go:898: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc test-pvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-377355 get pvc test-pvc -o jsonpath={.status.phase} -n default

addons_test.go:901: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...

helpers_test.go:344: "test-local-path" [fca7c4a0-ac53-4a62-8a99-4a10afd943ce] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])

helpers_test.go:344: "test-local-path" [fca7c4a0-ac53-4a62-8a99-4a10afd943ce] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted

helpers_test.go:344: "test-local-path" [fca7c4a0-ac53-4a62-8a99-4a10afd943ce] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted

addons_test.go:901: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 3.011398909s

addons_test.go:906: (dbg) Run:  kubectl --context addons-377355 get pvc test-pvc -o=json

addons_test.go:915: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 ssh "cat /opt/local-path-provisioner/pvc-3e68f2e0-11d8-4636-b9e0-b6cde3abea35_default_test-pvc/file1"

addons_test.go:927: (dbg) Run:  kubectl --context addons-377355 delete pod test-local-path

addons_test.go:931: (dbg) Run:  kubectl --context addons-377355 delete pvc test-pvc

addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 addons disable storage-provisioner-rancher --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-377355 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (43.527465798s)

--- PASS: TestAddons/parallel/LocalPath (53.06s)

=== RUN   TestAddons/parallel/NvidiaDevicePlugin

=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

=== CONT  TestAddons/parallel/NvidiaDevicePlugin

addons_test.go:964: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...

helpers_test.go:344: "nvidia-device-plugin-daemonset-cmllb" [a7806675-ca8e-438f-9bbb-693262581852] Running

addons_test.go:964: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 5.004549733s

addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 addons disable nvidia-device-plugin --alsologtostderr -v=1

--- PASS: TestAddons/parallel/NvidiaDevicePlugin (5.94s)

=== RUN   TestAddons/parallel/Yakd

=== PAUSE TestAddons/parallel/Yakd

=== CONT  TestAddons/parallel/Yakd

addons_test.go:986: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...

helpers_test.go:344: "yakd-dashboard-67d98fc6b-br5zf" [99a3f279-a91b-4750-84e5-77a161c46df5] Running

addons_test.go:986: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 5.00572595s

addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-377355 addons disable yakd --alsologtostderr -v=1

addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-377355 addons disable yakd --alsologtostderr -v=1: (5.856778s)

--- PASS: TestAddons/parallel/Yakd (10.86s)

=== RUN   TestAddons/StoppedEnableDisable

addons_test.go:170: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-377355

addons_test.go:170: (dbg) Done: out/minikube-linux-arm64 stop -p addons-377355: (12.017833018s)

addons_test.go:174: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-377355

addons_test.go:178: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-377355

addons_test.go:183: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-377355

--- PASS: TestAddons/StoppedEnableDisable (12.33s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-198698 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd

cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-198698 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd: (30.356009913s)

cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-198698 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-198698 config view

cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-198698 -- "sudo cat /etc/kubernetes/admin.conf"

helpers_test.go:175: Cleaning up "cert-options-198698" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-198698

helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-198698: (2.042748066s)

--- PASS: TestCertOptions (33.05s)

=== RUN   TestCertExpiration

=== PAUSE TestCertExpiration

=== CONT  TestCertExpiration

cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-488228 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd

E1104 11:14:31.932592    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-488228 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd: (40.477182058s)

cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-488228 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd

cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-488228 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd: (8.553728566s)

helpers_test.go:175: Cleaning up "cert-expiration-488228" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-488228

helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-488228: (2.25612907s)

--- PASS: TestCertExpiration (231.29s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:91: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-423712 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd

docker_test.go:91: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-423712 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (36.195610027s)

docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-423712 ssh "cat /etc/containerd/config.toml"

helpers_test.go:175: Cleaning up "force-systemd-flag-423712" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-423712

helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-423712: (2.349702138s)

--- PASS: TestForceSystemdFlag (38.96s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:155: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-346323 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd

docker_test.go:155: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-346323 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (40.101799028s)

docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-env-346323 ssh "cat /etc/containerd/config.toml"

helpers_test.go:175: Cleaning up "force-systemd-env-346323" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-346323

helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-346323: (2.546512821s)

--- PASS: TestForceSystemdEnv (43.10s)

=== RUN   TestDockerEnvContainerd

docker_test.go:170: running with containerd true linux arm64

docker_test.go:181: (dbg) Run:  out/minikube-linux-arm64 start -p dockerenv-984827 --driver=docker  --container-runtime=containerd

docker_test.go:181: (dbg) Done: out/minikube-linux-arm64 start -p dockerenv-984827 --driver=docker  --container-runtime=containerd: (29.330356483s)

docker_test.go:189: (dbg) Run:  /bin/bash -c "out/minikube-linux-arm64 docker-env --ssh-host --ssh-add -p dockerenv-984827"

docker_test.go:220: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-8LpgPCFTMsJh/agent.28599" SSH_AGENT_PID="28600" DOCKER_HOST=ssh://docker@127.0.0.1:32773 docker version"

docker_test.go:243: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-8LpgPCFTMsJh/agent.28599" SSH_AGENT_PID="28600" DOCKER_HOST=ssh://docker@127.0.0.1:32773 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env"

docker_test.go:243: (dbg) Done: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-8LpgPCFTMsJh/agent.28599" SSH_AGENT_PID="28600" DOCKER_HOST=ssh://docker@127.0.0.1:32773 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env": (1.087653983s)

docker_test.go:250: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-8LpgPCFTMsJh/agent.28599" SSH_AGENT_PID="28600" DOCKER_HOST=ssh://docker@127.0.0.1:32773 docker image ls"

helpers_test.go:175: Cleaning up "dockerenv-984827" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p dockerenv-984827

helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p dockerenv-984827: (1.941902904s)

--- PASS: TestDockerEnvContainerd (44.82s)

=== RUN   TestErrorSpam/setup

error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-192633 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-192633 --driver=docker  --container-runtime=containerd

error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-192633 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-192633 --driver=docker  --container-runtime=containerd: (28.965549357s)

--- PASS: TestErrorSpam/setup (28.97s)

=== RUN   TestErrorSpam/start

error_spam_test.go:216: Cleaning up 1 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 start --dry-run

error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 start --dry-run

error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 start --dry-run

--- PASS: TestErrorSpam/start (0.75s)

=== RUN   TestErrorSpam/status

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 status

error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 status

error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 status

--- PASS: TestErrorSpam/status (1.01s)

=== RUN   TestErrorSpam/pause

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 pause

error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 pause

error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 pause

--- PASS: TestErrorSpam/pause (1.86s)

=== RUN   TestErrorSpam/unpause

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 unpause

error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 unpause

error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 unpause

--- PASS: TestErrorSpam/unpause (1.78s)

=== RUN   TestErrorSpam/stop

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 stop

error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 stop: (1.252913962s)

error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 stop

error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-192633 --log_dir /tmp/nospam-192633 stop

--- PASS: TestErrorSpam/stop (1.45s)

=== RUN   TestFunctional/serial/CopySyncFile

functional_test.go:1855: local sync path: /home/jenkins/minikube-integration/19906-2243/.minikube/files/etc/test/nested/copy/7687/hosts

--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

=== RUN   TestFunctional/serial/StartWithProxy

functional_test.go:2234: (dbg) Run:  out/minikube-linux-arm64 start -p functional-877284 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd

E1104 10:39:31.934582    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

E1104 10:39:31.941568    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

E1104 10:39:31.952928    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

E1104 10:39:31.974299    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

E1104 10:39:32.015680    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

E1104 10:39:32.097148    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

E1104 10:39:32.258730    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

E1104 10:39:32.580403    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

E1104 10:39:33.222088    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

E1104 10:39:34.504172    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

E1104 10:39:37.066692    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

E1104 10:39:42.189215    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

E1104 10:39:52.431515    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

functional_test.go:2234: (dbg) Done: out/minikube-linux-arm64 start -p functional-877284 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd: (58.269634194s)

--- PASS: TestFunctional/serial/StartWithProxy (58.27s)

=== RUN   TestFunctional/serial/AuditLog

--- PASS: TestFunctional/serial/AuditLog (0.00s)

=== RUN   TestFunctional/serial/SoftStart

I1104 10:39:59.344951    7687 config.go:182] Loaded profile config "functional-877284": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2

functional_test.go:659: (dbg) Run:  out/minikube-linux-arm64 start -p functional-877284 --alsologtostderr -v=8

functional_test.go:659: (dbg) Done: out/minikube-linux-arm64 start -p functional-877284 --alsologtostderr -v=8: (6.841595816s)

functional_test.go:663: soft start took 6.843375102s for "functional-877284" cluster.

I1104 10:40:06.186874    7687 config.go:182] Loaded profile config "functional-877284": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2

--- PASS: TestFunctional/serial/SoftStart (6.84s)

=== RUN   TestFunctional/serial/KubeContext

functional_test.go:681: (dbg) Run:  kubectl config current-context

--- PASS: TestFunctional/serial/KubeContext (0.07s)

=== RUN   TestFunctional/serial/KubectlGetPods

functional_test.go:696: (dbg) Run:  kubectl --context functional-877284 get po -A

--- PASS: TestFunctional/serial/KubectlGetPods (0.11s)

=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote

functional_test.go:1049: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 cache add registry.k8s.io/pause:3.1

functional_test.go:1049: (dbg) Done: out/minikube-linux-arm64 -p functional-877284 cache add registry.k8s.io/pause:3.1: (1.415058481s)

functional_test.go:1049: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 cache add registry.k8s.io/pause:3.3

functional_test.go:1049: (dbg) Done: out/minikube-linux-arm64 -p functional-877284 cache add registry.k8s.io/pause:3.3: (1.431901731s)

functional_test.go:1049: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 cache add registry.k8s.io/pause:latest

functional_test.go:1049: (dbg) Done: out/minikube-linux-arm64 -p functional-877284 cache add registry.k8s.io/pause:latest: (1.181905715s)

--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (4.03s)

=== RUN   TestFunctional/serial/CacheCmd/cache/add_local

functional_test.go:1077: (dbg) Run:  docker build -t minikube-local-cache-test:functional-877284 /tmp/TestFunctionalserialCacheCmdcacheadd_local2026213438/001

functional_test.go:1089: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 cache add minikube-local-cache-test:functional-877284

functional_test.go:1094: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 cache delete minikube-local-cache-test:functional-877284

functional_test.go:1083: (dbg) Run:  docker rmi minikube-local-cache-test:functional-877284

--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.17s)

=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete

functional_test.go:1102: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3

--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

=== RUN   TestFunctional/serial/CacheCmd/cache/list

functional_test.go:1110: (dbg) Run:  out/minikube-linux-arm64 cache list

--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.07s)

=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node

functional_test.go:1124: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 ssh sudo crictl images

--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.34s)

=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload

functional_test.go:1147: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 ssh sudo crictl rmi registry.k8s.io/pause:latest

functional_test.go:1153: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 ssh sudo crictl inspecti registry.k8s.io/pause:latest

functional_test.go:1153: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-877284 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (283.00212ms)

-- stdout --

	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

-- /stdout --

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

functional_test.go:1158: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 cache reload

E1104 10:40:12.913161    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

functional_test.go:1158: (dbg) Done: out/minikube-linux-arm64 -p functional-877284 cache reload: (1.09299375s)

functional_test.go:1163: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 ssh sudo crictl inspecti registry.k8s.io/pause:latest

--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (2.00s)

=== RUN   TestFunctional/serial/CacheCmd/cache/delete

functional_test.go:1172: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1

functional_test.go:1172: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest

--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.13s)

=== RUN   TestFunctional/serial/MinikubeKubectlCmd

functional_test.go:716: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 kubectl -- --context functional-877284 get pods

--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.16s)

=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly

functional_test.go:741: (dbg) Run:  out/kubectl --context functional-877284 get pods

--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.14s)

=== RUN   TestFunctional/serial/ExtraConfig

functional_test.go:757: (dbg) Run:  out/minikube-linux-arm64 start -p functional-877284 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all

E1104 10:40:53.875470    7687 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19906-2243/.minikube/profiles/addons-377355/client.crt: no such file or directory" logger="UnhandledError"

functional_test.go:757: (dbg) Done: out/minikube-linux-arm64 start -p functional-877284 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (45.426961791s)

functional_test.go:761: restart took 45.427087426s for "functional-877284" cluster.

I1104 10:40:59.880286    7687 config.go:182] Loaded profile config "functional-877284": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2

--- PASS: TestFunctional/serial/ExtraConfig (45.43s)

=== RUN   TestFunctional/serial/ComponentHealth

functional_test.go:810: (dbg) Run:  kubectl --context functional-877284 get po -l tier=control-plane -n kube-system -o=json

functional_test.go:825: etcd phase: Running

functional_test.go:835: etcd status: Ready

functional_test.go:825: kube-apiserver phase: Running

functional_test.go:835: kube-apiserver status: Ready

functional_test.go:825: kube-controller-manager phase: Running

functional_test.go:835: kube-controller-manager status: Ready

functional_test.go:825: kube-scheduler phase: Running

functional_test.go:835: kube-scheduler status: Ready

--- PASS: TestFunctional/serial/ComponentHealth (0.10s)

=== RUN   TestFunctional/serial/LogsCmd

functional_test.go:1236: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 logs

functional_test.go:1236: (dbg) Done: out/minikube-linux-arm64 -p functional-877284 logs: (1.962559812s)

--- PASS: TestFunctional/serial/LogsCmd (1.96s)

=== RUN   TestFunctional/serial/LogsFileCmd

functional_test.go:1250: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 logs --file /tmp/TestFunctionalserialLogsFileCmd2343033314/001/logs.txt

functional_test.go:1250: (dbg) Done: out/minikube-linux-arm64 -p functional-877284 logs --file /tmp/TestFunctionalserialLogsFileCmd2343033314/001/logs.txt: (1.710587348s)

--- PASS: TestFunctional/serial/LogsFileCmd (1.71s)

=== RUN   TestFunctional/serial/InvalidService

functional_test.go:2321: (dbg) Run:  kubectl --context functional-877284 apply -f testdata/invalidsvc.yaml

functional_test.go:2335: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-877284

functional_test.go:2335: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-877284: exit status 115 (426.795956ms)

-- stdout --

	|-----------|-------------|-------------|---------------------------|

	| NAMESPACE |    NAME     | TARGET PORT |            URL            |

	|-----------|-------------|-------------|---------------------------|

	| default   | invalid-svc |          80 | http://192.168.49.2:30816 |

	|-----------|-------------|-------------|---------------------------|

-- /stdout --

** stderr ** 

	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

functional_test.go:2327: (dbg) Run:  kubectl --context functional-877284 delete -f testdata/invalidsvc.yaml

--- PASS: TestFunctional/serial/InvalidService (4.42s)

=== RUN   TestFunctional/parallel/ConfigCmd

=== PAUSE TestFunctional/parallel/ConfigCmd

=== CONT  TestFunctional/parallel/ConfigCmd

functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 config unset cpus

functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 config get cpus

functional_test.go:1199: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-877284 config get cpus: exit status 14 (84.340073ms)

** stderr ** 

	Error: specified key could not be found in config

** /stderr **

functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 config set cpus 2

functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 config get cpus

functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 config unset cpus

functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 config get cpus

functional_test.go:1199: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-877284 config get cpus: exit status 14 (96.558991ms)

** stderr ** 

	Error: specified key could not be found in config

** /stderr **

--- PASS: TestFunctional/parallel/ConfigCmd (0.52s)

=== RUN   TestFunctional/parallel/DashboardCmd

=== PAUSE TestFunctional/parallel/DashboardCmd

=== CONT  TestFunctional/parallel/DashboardCmd

functional_test.go:905: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-877284 --alsologtostderr -v=1]

functional_test.go:910: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-877284 --alsologtostderr -v=1] ...

helpers_test.go:508: unable to kill pid 45086: os: process already finished

--- PASS: TestFunctional/parallel/DashboardCmd (9.30s)

=== RUN   TestFunctional/parallel/DryRun

=== PAUSE TestFunctional/parallel/DryRun

=== CONT  TestFunctional/parallel/DryRun

functional_test.go:974: (dbg) Run:  out/minikube-linux-arm64 start -p functional-877284 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd

functional_test.go:974: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-877284 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (179.325144ms)

-- stdout --

	* [functional-877284] minikube v1.34.0 on Ubuntu 20.04 (arm64)

	  - MINIKUBE_LOCATION=19906

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/19906-2243/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19906-2243/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-arm64

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the docker driver based on existing profile

-- /stdout --

** stderr ** 

	I1104 10:41:51.579503   44800 out.go:345] Setting OutFile to fd 1 ...

	I1104 10:41:51.579661   44800 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1104 10:41:51.579667   44800 out.go:358] Setting ErrFile to fd 2...

	I1104 10:41:51.579673   44800 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1104 10:41:51.580924   44800 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19906-2243/.minikube/bin

	I1104 10:41:51.581611   44800 out.go:352] Setting JSON to false

	I1104 10:41:51.582951   44800 start.go:129] hostinfo: {"hostname":"ip-172-31-24-2","uptime":1463,"bootTime":1730715449,"procs":207,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"6d436adf-771e-4269-b9a3-c25fd4fca4f5"}

	I1104 10:41:51.583083   44800 start.go:139] virtualization:  

	I1104 10:41:51.586022   44800 out.go:177] * [functional-877284] minikube v1.34.0 on Ubuntu 20.04 (arm64)

	I1104 10:41:51.588485   44800 out.go:177]   - MINIKUBE_LOCATION=19906

	I1104 10:41:51.590680   44800 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1104 10:41:51.591084   44800 notify.go:220] Checking for updates...

	I1104 10:41:51.595048   44800 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19906-2243/kubeconfig

	I1104 10:41:51.596931   44800 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19906-2243/.minikube

	I1104 10:41:51.598930   44800 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64

	I1104 10:41:51.601036   44800 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1104 10:41:51.603351   44800 config.go:182] Loaded profile config "functional-877284": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2

	I1104 10:41:51.604081   44800 driver.go:394] Setting default libvirt URI to qemu:///system

	I1104 10:41:51.631094   44800 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community

	I1104 10:41:51.631217   44800 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1104 10:41:51.691704   44800 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:32 OomKillDisable:true NGoroutines:52 SystemTime:2024-11-04 10:41:51.681552491 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a

arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge

-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}

	I1104 10:41:51.691822   44800 docker.go:318] overlay module found

	I1104 10:41:51.693999   44800 out.go:177] * Using the docker driver based on existing profile

	I1104 10:41:51.695976   44800 start.go:297] selected driver: docker

	I1104 10:41:51.696000   44800 start.go:901] validating driver "docker" against &{Name:functional-877284 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:functional-877284 Namespace:default APIServerHAVIP: APIServerNa

me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do

cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1104 10:41:51.696134   44800 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1104 10:41:51.698777   44800 out.go:201] 

	W1104 10:41:51.700779   44800 out.go:270] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB

	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB

	I1104 10:41:51.702766   44800 out.go:201] 

** /stderr **

functional_test.go:991: (dbg) Run:  out/minikube-linux-arm64 start -p functional-877284 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd

--- PASS: TestFunctional/parallel/DryRun (0.41s)

=== RUN   TestFunctional/parallel/InternationalLanguage

=== PAUSE TestFunctional/parallel/InternationalLanguage

=== CONT  TestFunctional/parallel/InternationalLanguage

functional_test.go:1020: (dbg) Run:  out/minikube-linux-arm64 start -p functional-877284 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd

functional_test.go:1020: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-877284 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (186.19736ms)

-- stdout --

	* [functional-877284] minikube v1.34.0 sur Ubuntu 20.04 (arm64)

	  - MINIKUBE_LOCATION=19906

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/19906-2243/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19906-2243/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-arm64

	  - MINIKUBE_FORCE_SYSTEMD=

	* Utilisation du pilote docker basé sur le profil existant

-- /stdout --

** stderr ** 

	I1104 10:41:52.002390   44916 out.go:345] Setting OutFile to fd 1 ...

	I1104 10:41:52.003150   44916 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1104 10:41:52.003173   44916 out.go:358] Setting ErrFile to fd 2...

	I1104 10:41:52.003179   44916 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1104 10:41:52.004293   44916 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19906-2243/.minikube/bin

	I1104 10:41:52.004791   44916 out.go:352] Setting JSON to false

	I1104 10:41:52.005786   44916 start.go:129] hostinfo: {"hostname":"ip-172-31-24-2","uptime":1463,"bootTime":1730715449,"procs":207,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"6d436adf-771e-4269-b9a3-c25fd4fca4f5"}

	I1104 10:41:52.005879   44916 start.go:139] virtualization:  

	I1104 10:41:52.008464   44916 out.go:177] * [functional-877284] minikube v1.34.0 sur Ubuntu 20.04 (arm64)

	I1104 10:41:52.010742   44916 out.go:177]   - MINIKUBE_LOCATION=19906

	I1104 10:41:52.010865   44916 notify.go:220] Checking for updates...

	I1104 10:41:52.014871   44916 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1104 10:41:52.017516   44916 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19906-2243/kubeconfig

	I1104 10:41:52.019860   44916 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19906-2243/.minikube

	I1104 10:41:52.021870   44916 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64

	I1104 10:41:52.024285   44916 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1104 10:41:52.026909   44916 config.go:182] Loaded profile config "functional-877284": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2

	I1104 10:41:52.027442   44916 driver.go:394] Setting default libvirt URI to qemu:///system

	I1104 10:41:52.052504   44916 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community

	I1104 10:41:52.052631   44916 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1104 10:41:52.111340   44916 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:32 OomKillDisable:true NGoroutines:52 SystemTime:2024-11-04 10:41:52.101866051 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a

arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge

-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}

	I1104 10:41:52.111464   44916 docker.go:318] overlay module found

	I1104 10:41:52.113798   44916 out.go:177] * Utilisation du pilote docker basé sur le profil existant

	I1104 10:41:52.115751   44916 start.go:297] selected driver: docker

	I1104 10:41:52.115773   44916 start.go:901] validating driver "docker" against &{Name:functional-877284 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:functional-877284 Namespace:default APIServerHAVIP: APIServerNa

me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do

cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1104 10:41:52.115886   44916 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1104 10:41:52.118447   44916 out.go:201] 

	W1104 10:41:52.120436   44916 out.go:270] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo

	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo

	I1104 10:41:52.122205   44916 out.go:201] 

** /stderr **

--- PASS: TestFunctional/parallel/InternationalLanguage (0.19s)

=== RUN   TestFunctional/parallel/StatusCmd

=== PAUSE TestFunctional/parallel/StatusCmd

=== CONT  TestFunctional/parallel/StatusCmd

functional_test.go:854: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 status

functional_test.go:860: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}

functional_test.go:872: (dbg) Run:  out/minikube-linux-arm64 -p functional-877284 status -o json

--- PASS: TestFunctional/parallel/StatusCmd (1.16s)