Test Report: Docker_Linux_containerd_arm64 19872

                    
                      d8c730041b5457cdbe5017f8cce276eb986ed9a4:2024-10-28:36847
                    
                

Test fail (1/330)

Order failed test Duration
304 TestStartStop/group/old-k8s-version/serial/SecondStart 377.31
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (377.31s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-743648 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-743648 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m13.227449091s)

                                                
                                                
-- stdout --
	* [old-k8s-version-743648] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19872
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.31.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.2
	* Using the docker driver based on existing profile
	* Starting "old-k8s-version-743648" primary control-plane node in "old-k8s-version-743648" cluster
	* Pulling base image v0.0.45-1730110049-19872 ...
	* Restarting existing docker container for "old-k8s-version-743648" ...
	* Preparing Kubernetes v1.20.0 on containerd 1.7.22 ...
	* Verifying Kubernetes components...
	  - Using image docker.io/kubernetesui/dashboard:v2.7.0
	  - Using image registry.k8s.io/echoserver:1.4
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	  - Using image fake.domain/registry.k8s.io/echoserver:1.4
	* Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p old-k8s-version-743648 addons enable metrics-server
	
	* Enabled addons: storage-provisioner, dashboard, default-storageclass, metrics-server
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 17:50:19.991047  215146 out.go:345] Setting OutFile to fd 1 ...
	I1028 17:50:19.991247  215146 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:50:19.991274  215146 out.go:358] Setting ErrFile to fd 2...
	I1028 17:50:19.991296  215146 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:50:19.991675  215146 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
	I1028 17:50:19.993059  215146 out.go:352] Setting JSON to false
	I1028 17:50:19.995498  215146 start.go:129] hostinfo: {"hostname":"ip-172-31-24-2","uptime":5566,"bootTime":1730132254,"procs":205,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"6d436adf-771e-4269-b9a3-c25fd4fca4f5"}
	I1028 17:50:19.995601  215146 start.go:139] virtualization:  
	I1028 17:50:19.999133  215146 out.go:177] * [old-k8s-version-743648] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	I1028 17:50:20.003373  215146 out.go:177]   - MINIKUBE_LOCATION=19872
	I1028 17:50:20.003548  215146 notify.go:220] Checking for updates...
	I1028 17:50:20.026125  215146 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 17:50:20.028897  215146 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig
	I1028 17:50:20.039505  215146 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube
	I1028 17:50:20.042165  215146 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I1028 17:50:20.046316  215146 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 17:50:20.048863  215146 config.go:182] Loaded profile config "old-k8s-version-743648": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I1028 17:50:20.051473  215146 out.go:177] * Kubernetes 1.31.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.31.2
	I1028 17:50:20.054193  215146 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 17:50:20.107640  215146 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
	I1028 17:50:20.107794  215146 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1028 17:50:20.186026  215146 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:41 OomKillDisable:true NGoroutines:59 SystemTime:2024-10-28 17:50:20.169536407 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I1028 17:50:20.186147  215146 docker.go:318] overlay module found
	I1028 17:50:20.188735  215146 out.go:177] * Using the docker driver based on existing profile
	I1028 17:50:20.190622  215146 start.go:297] selected driver: docker
	I1028 17:50:20.190644  215146 start.go:901] validating driver "docker" against &{Name:old-k8s-version-743648 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-743648 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 17:50:20.190776  215146 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 17:50:20.191556  215146 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1028 17:50:20.284723  215146 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:41 OomKillDisable:true NGoroutines:59 SystemTime:2024-10-28 17:50:20.273393374 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I1028 17:50:20.285170  215146 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 17:50:20.285216  215146 cni.go:84] Creating CNI manager for ""
	I1028 17:50:20.285270  215146 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I1028 17:50:20.285327  215146 start.go:340] cluster config:
	{Name:old-k8s-version-743648 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-743648 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 17:50:20.291045  215146 out.go:177] * Starting "old-k8s-version-743648" primary control-plane node in "old-k8s-version-743648" cluster
	I1028 17:50:20.293792  215146 cache.go:121] Beginning downloading kic base image for docker with containerd
	I1028 17:50:20.296171  215146 out.go:177] * Pulling base image v0.0.45-1730110049-19872 ...
	I1028 17:50:20.298413  215146 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I1028 17:50:20.298472  215146 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19872-2421/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
	I1028 17:50:20.298486  215146 cache.go:56] Caching tarball of preloaded images
	I1028 17:50:20.298506  215146 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 in local docker daemon
	I1028 17:50:20.298590  215146 preload.go:172] Found /home/jenkins/minikube-integration/19872-2421/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I1028 17:50:20.298600  215146 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
	I1028 17:50:20.298717  215146 profile.go:143] Saving config to /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/config.json ...
	I1028 17:50:20.319178  215146 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 in local docker daemon, skipping pull
	I1028 17:50:20.319198  215146 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 exists in daemon, skipping load
	I1028 17:50:20.319211  215146 cache.go:194] Successfully downloaded all kic artifacts
	I1028 17:50:20.319235  215146 start.go:360] acquireMachinesLock for old-k8s-version-743648: {Name:mkbc946fc9b9661051d822ab54db26a6d4c41906 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 17:50:20.319290  215146 start.go:364] duration metric: took 38.843µs to acquireMachinesLock for "old-k8s-version-743648"
	I1028 17:50:20.319310  215146 start.go:96] Skipping create...Using existing machine configuration
	I1028 17:50:20.319315  215146 fix.go:54] fixHost starting: 
	I1028 17:50:20.319564  215146 cli_runner.go:164] Run: docker container inspect old-k8s-version-743648 --format={{.State.Status}}
	I1028 17:50:20.344198  215146 fix.go:112] recreateIfNeeded on old-k8s-version-743648: state=Stopped err=<nil>
	W1028 17:50:20.344290  215146 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 17:50:20.347346  215146 out.go:177] * Restarting existing docker container for "old-k8s-version-743648" ...
	I1028 17:50:20.349827  215146 cli_runner.go:164] Run: docker start old-k8s-version-743648
	I1028 17:50:20.703211  215146 cli_runner.go:164] Run: docker container inspect old-k8s-version-743648 --format={{.State.Status}}
	I1028 17:50:20.726819  215146 kic.go:430] container "old-k8s-version-743648" state is running.
	I1028 17:50:20.727199  215146 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-743648
	I1028 17:50:20.769975  215146 profile.go:143] Saving config to /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/config.json ...
	I1028 17:50:20.770192  215146 machine.go:93] provisionDockerMachine start ...
	I1028 17:50:20.770264  215146 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-743648
	I1028 17:50:20.795177  215146 main.go:141] libmachine: Using SSH client type: native
	I1028 17:50:20.796195  215146 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x415580] 0x417dc0 <nil>  [] 0s} 127.0.0.1 33066 <nil> <nil>}
	I1028 17:50:20.796226  215146 main.go:141] libmachine: About to run SSH command:
	hostname
	I1028 17:50:20.800337  215146 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I1028 17:50:23.971790  215146 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-743648
	
	I1028 17:50:23.971863  215146 ubuntu.go:169] provisioning hostname "old-k8s-version-743648"
	I1028 17:50:23.971949  215146 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-743648
	I1028 17:50:24.064759  215146 main.go:141] libmachine: Using SSH client type: native
	I1028 17:50:24.065026  215146 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x415580] 0x417dc0 <nil>  [] 0s} 127.0.0.1 33066 <nil> <nil>}
	I1028 17:50:24.065044  215146 main.go:141] libmachine: About to run SSH command:
	sudo hostname old-k8s-version-743648 && echo "old-k8s-version-743648" | sudo tee /etc/hostname
	I1028 17:50:24.244992  215146 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-743648
	
	I1028 17:50:24.245112  215146 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-743648
	I1028 17:50:24.268495  215146 main.go:141] libmachine: Using SSH client type: native
	I1028 17:50:24.268765  215146 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x415580] 0x417dc0 <nil>  [] 0s} 127.0.0.1 33066 <nil> <nil>}
	I1028 17:50:24.268784  215146 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sold-k8s-version-743648' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-743648/g' /etc/hosts;
				else 
					echo '127.0.1.1 old-k8s-version-743648' | sudo tee -a /etc/hosts; 
				fi
			fi
	I1028 17:50:24.428378  215146 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I1028 17:50:24.428403  215146 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19872-2421/.minikube CaCertPath:/home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19872-2421/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19872-2421/.minikube}
	I1028 17:50:24.428467  215146 ubuntu.go:177] setting up certificates
	I1028 17:50:24.428478  215146 provision.go:84] configureAuth start
	I1028 17:50:24.428577  215146 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-743648
	I1028 17:50:24.449907  215146 provision.go:143] copyHostCerts
	I1028 17:50:24.449989  215146 exec_runner.go:144] found /home/jenkins/minikube-integration/19872-2421/.minikube/ca.pem, removing ...
	I1028 17:50:24.450009  215146 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19872-2421/.minikube/ca.pem
	I1028 17:50:24.450079  215146 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19872-2421/.minikube/ca.pem (1082 bytes)
	I1028 17:50:24.450206  215146 exec_runner.go:144] found /home/jenkins/minikube-integration/19872-2421/.minikube/cert.pem, removing ...
	I1028 17:50:24.450216  215146 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19872-2421/.minikube/cert.pem
	I1028 17:50:24.450251  215146 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19872-2421/.minikube/cert.pem (1123 bytes)
	I1028 17:50:24.450305  215146 exec_runner.go:144] found /home/jenkins/minikube-integration/19872-2421/.minikube/key.pem, removing ...
	I1028 17:50:24.450315  215146 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19872-2421/.minikube/key.pem
	I1028 17:50:24.450340  215146 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19872-2421/.minikube/key.pem (1679 bytes)
	I1028 17:50:24.450391  215146 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19872-2421/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-743648 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-743648]
	I1028 17:50:24.906539  215146 provision.go:177] copyRemoteCerts
	I1028 17:50:24.906633  215146 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I1028 17:50:24.906703  215146 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-743648
	I1028 17:50:24.926000  215146 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33066 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/old-k8s-version-743648/id_rsa Username:docker}
	I1028 17:50:25.054838  215146 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I1028 17:50:25.091061  215146 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
	I1028 17:50:25.123922  215146 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I1028 17:50:25.155905  215146 provision.go:87] duration metric: took 727.406581ms to configureAuth
	I1028 17:50:25.155982  215146 ubuntu.go:193] setting minikube options for container-runtime
	I1028 17:50:25.156232  215146 config.go:182] Loaded profile config "old-k8s-version-743648": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I1028 17:50:25.156267  215146 machine.go:96] duration metric: took 4.386058077s to provisionDockerMachine
	I1028 17:50:25.156304  215146 start.go:293] postStartSetup for "old-k8s-version-743648" (driver="docker")
	I1028 17:50:25.156329  215146 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I1028 17:50:25.156434  215146 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I1028 17:50:25.156513  215146 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-743648
	I1028 17:50:25.174762  215146 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33066 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/old-k8s-version-743648/id_rsa Username:docker}
	I1028 17:50:25.278164  215146 ssh_runner.go:195] Run: cat /etc/os-release
	I1028 17:50:25.282579  215146 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I1028 17:50:25.282616  215146 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I1028 17:50:25.282629  215146 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I1028 17:50:25.282636  215146 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I1028 17:50:25.282647  215146 filesync.go:126] Scanning /home/jenkins/minikube-integration/19872-2421/.minikube/addons for local assets ...
	I1028 17:50:25.282709  215146 filesync.go:126] Scanning /home/jenkins/minikube-integration/19872-2421/.minikube/files for local assets ...
	I1028 17:50:25.282795  215146 filesync.go:149] local asset: /home/jenkins/minikube-integration/19872-2421/.minikube/files/etc/ssl/certs/78662.pem -> 78662.pem in /etc/ssl/certs
	I1028 17:50:25.282901  215146 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I1028 17:50:25.292760  215146 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/files/etc/ssl/certs/78662.pem --> /etc/ssl/certs/78662.pem (1708 bytes)
	I1028 17:50:25.330080  215146 start.go:296] duration metric: took 173.747543ms for postStartSetup
	I1028 17:50:25.330254  215146 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I1028 17:50:25.330334  215146 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-743648
	I1028 17:50:25.352663  215146 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33066 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/old-k8s-version-743648/id_rsa Username:docker}
	I1028 17:50:25.462342  215146 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I1028 17:50:25.467925  215146 fix.go:56] duration metric: took 5.148602418s for fixHost
	I1028 17:50:25.467949  215146 start.go:83] releasing machines lock for "old-k8s-version-743648", held for 5.148651837s
	I1028 17:50:25.468018  215146 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-743648
	I1028 17:50:25.488857  215146 ssh_runner.go:195] Run: cat /version.json
	I1028 17:50:25.488879  215146 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I1028 17:50:25.488920  215146 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-743648
	I1028 17:50:25.488931  215146 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-743648
	I1028 17:50:25.509058  215146 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33066 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/old-k8s-version-743648/id_rsa Username:docker}
	I1028 17:50:25.516871  215146 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33066 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/old-k8s-version-743648/id_rsa Username:docker}
	I1028 17:50:25.612643  215146 ssh_runner.go:195] Run: systemctl --version
	I1028 17:50:25.768794  215146 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I1028 17:50:25.775061  215146 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I1028 17:50:25.813893  215146 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I1028 17:50:25.814065  215146 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I1028 17:50:25.824681  215146 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I1028 17:50:25.824784  215146 start.go:495] detecting cgroup driver to use...
	I1028 17:50:25.824831  215146 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I1028 17:50:25.824914  215146 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I1028 17:50:25.848276  215146 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I1028 17:50:25.861448  215146 docker.go:217] disabling cri-docker service (if available) ...
	I1028 17:50:25.861562  215146 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I1028 17:50:25.878277  215146 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I1028 17:50:25.893391  215146 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I1028 17:50:26.002788  215146 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I1028 17:50:26.108432  215146 docker.go:233] disabling docker service ...
	I1028 17:50:26.108499  215146 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I1028 17:50:26.122141  215146 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I1028 17:50:26.135019  215146 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I1028 17:50:26.222799  215146 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I1028 17:50:26.314513  215146 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I1028 17:50:26.327373  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1028 17:50:26.345072  215146 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
	I1028 17:50:26.356832  215146 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I1028 17:50:26.369274  215146 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I1028 17:50:26.369418  215146 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I1028 17:50:26.379629  215146 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1028 17:50:26.390409  215146 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I1028 17:50:26.404810  215146 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1028 17:50:26.419769  215146 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I1028 17:50:26.429535  215146 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I1028 17:50:26.439084  215146 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I1028 17:50:26.447838  215146 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I1028 17:50:26.456575  215146 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 17:50:26.564583  215146 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I1028 17:50:26.825289  215146 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
	I1028 17:50:26.825357  215146 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I1028 17:50:26.829708  215146 start.go:563] Will wait 60s for crictl version
	I1028 17:50:26.829773  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:50:26.833564  215146 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I1028 17:50:26.901023  215146 start.go:579] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.7.22
	RuntimeApiVersion:  v1
	I1028 17:50:26.901102  215146 ssh_runner.go:195] Run: containerd --version
	I1028 17:50:26.933653  215146 ssh_runner.go:195] Run: containerd --version
	I1028 17:50:26.965162  215146 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.22 ...
	I1028 17:50:26.966982  215146 cli_runner.go:164] Run: docker network inspect old-k8s-version-743648 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I1028 17:50:26.987582  215146 ssh_runner.go:195] Run: grep 192.168.76.1	host.minikube.internal$ /etc/hosts
	I1028 17:50:26.991459  215146 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1028 17:50:27.002598  215146 kubeadm.go:883] updating cluster {Name:old-k8s-version-743648 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-743648 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I1028 17:50:27.002717  215146 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I1028 17:50:27.002775  215146 ssh_runner.go:195] Run: sudo crictl images --output json
	I1028 17:50:27.070631  215146 containerd.go:627] all images are preloaded for containerd runtime.
	I1028 17:50:27.070656  215146 containerd.go:534] Images already preloaded, skipping extraction
	I1028 17:50:27.070714  215146 ssh_runner.go:195] Run: sudo crictl images --output json
	I1028 17:50:27.115982  215146 containerd.go:627] all images are preloaded for containerd runtime.
	I1028 17:50:27.116005  215146 cache_images.go:84] Images are preloaded, skipping loading
	I1028 17:50:27.116013  215146 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
	I1028 17:50:27.116130  215146 kubeadm.go:946] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-743648 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-743648 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I1028 17:50:27.116202  215146 ssh_runner.go:195] Run: sudo crictl info
	I1028 17:50:27.178579  215146 cni.go:84] Creating CNI manager for ""
	I1028 17:50:27.178607  215146 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I1028 17:50:27.178618  215146 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I1028 17:50:27.178638  215146 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-743648 NodeName:old-k8s-version-743648 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
	I1028 17:50:27.178782  215146 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.76.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "old-k8s-version-743648"
	  kubeletExtraArgs:
	    node-ip: 192.168.76.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.20.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I1028 17:50:27.178859  215146 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
	I1028 17:50:27.204103  215146 binaries.go:44] Found k8s binaries, skipping transfer
	I1028 17:50:27.204194  215146 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I1028 17:50:27.217118  215146 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
	I1028 17:50:27.238643  215146 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I1028 17:50:27.261729  215146 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
	I1028 17:50:27.289624  215146 ssh_runner.go:195] Run: grep 192.168.76.2	control-plane.minikube.internal$ /etc/hosts
	I1028 17:50:27.298073  215146 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1028 17:50:27.311532  215146 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 17:50:27.405362  215146 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I1028 17:50:27.421193  215146 certs.go:68] Setting up /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648 for IP: 192.168.76.2
	I1028 17:50:27.421220  215146 certs.go:194] generating shared ca certs ...
	I1028 17:50:27.421237  215146 certs.go:226] acquiring lock for ca certs: {Name:mk3457f8c75e004d4fb7865e732d1b8d6b3cdec9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 17:50:27.421382  215146 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19872-2421/.minikube/ca.key
	I1028 17:50:27.421431  215146 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19872-2421/.minikube/proxy-client-ca.key
	I1028 17:50:27.421442  215146 certs.go:256] generating profile certs ...
	I1028 17:50:27.421551  215146 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.key
	I1028 17:50:27.421637  215146 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/apiserver.key.2257cf18
	I1028 17:50:27.421685  215146 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/proxy-client.key
	I1028 17:50:27.421796  215146 certs.go:484] found cert: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/7866.pem (1338 bytes)
	W1028 17:50:27.421831  215146 certs.go:480] ignoring /home/jenkins/minikube-integration/19872-2421/.minikube/certs/7866_empty.pem, impossibly tiny 0 bytes
	I1028 17:50:27.421845  215146 certs.go:484] found cert: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca-key.pem (1679 bytes)
	I1028 17:50:27.421871  215146 certs.go:484] found cert: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca.pem (1082 bytes)
	I1028 17:50:27.421900  215146 certs.go:484] found cert: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/cert.pem (1123 bytes)
	I1028 17:50:27.421926  215146 certs.go:484] found cert: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/key.pem (1679 bytes)
	I1028 17:50:27.421972  215146 certs.go:484] found cert: /home/jenkins/minikube-integration/19872-2421/.minikube/files/etc/ssl/certs/78662.pem (1708 bytes)
	I1028 17:50:27.422643  215146 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I1028 17:50:27.449952  215146 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I1028 17:50:27.476788  215146 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I1028 17:50:27.515058  215146 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I1028 17:50:27.569091  215146 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I1028 17:50:27.604883  215146 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I1028 17:50:27.636363  215146 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I1028 17:50:27.674607  215146 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I1028 17:50:27.715447  215146 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/files/etc/ssl/certs/78662.pem --> /usr/share/ca-certificates/78662.pem (1708 bytes)
	I1028 17:50:27.745184  215146 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I1028 17:50:27.775170  215146 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/certs/7866.pem --> /usr/share/ca-certificates/7866.pem (1338 bytes)
	I1028 17:50:27.805078  215146 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I1028 17:50:27.829444  215146 ssh_runner.go:195] Run: openssl version
	I1028 17:50:27.835701  215146 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/78662.pem && ln -fs /usr/share/ca-certificates/78662.pem /etc/ssl/certs/78662.pem"
	I1028 17:50:27.847499  215146 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/78662.pem
	I1028 17:50:27.851815  215146 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 28 17:09 /usr/share/ca-certificates/78662.pem
	I1028 17:50:27.851886  215146 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/78662.pem
	I1028 17:50:27.859727  215146 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/78662.pem /etc/ssl/certs/3ec20f2e.0"
	I1028 17:50:27.869455  215146 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I1028 17:50:27.881983  215146 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I1028 17:50:27.885937  215146 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 28 17:01 /usr/share/ca-certificates/minikubeCA.pem
	I1028 17:50:27.886018  215146 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I1028 17:50:27.893448  215146 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I1028 17:50:27.905547  215146 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7866.pem && ln -fs /usr/share/ca-certificates/7866.pem /etc/ssl/certs/7866.pem"
	I1028 17:50:27.918688  215146 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7866.pem
	I1028 17:50:27.923253  215146 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 28 17:09 /usr/share/ca-certificates/7866.pem
	I1028 17:50:27.923354  215146 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7866.pem
	I1028 17:50:27.931280  215146 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7866.pem /etc/ssl/certs/51391683.0"
	I1028 17:50:27.943335  215146 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I1028 17:50:27.947377  215146 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I1028 17:50:27.954733  215146 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I1028 17:50:27.963477  215146 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I1028 17:50:27.971061  215146 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I1028 17:50:27.978769  215146 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I1028 17:50:27.986162  215146 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I1028 17:50:27.993678  215146 kubeadm.go:392] StartCluster: {Name:old-k8s-version-743648 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-743648 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 17:50:27.993804  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I1028 17:50:27.993884  215146 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I1028 17:50:28.067677  215146 cri.go:89] found id: "697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e"
	I1028 17:50:28.067725  215146 cri.go:89] found id: "eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d"
	I1028 17:50:28.067730  215146 cri.go:89] found id: "e3ff6f6a8a7ec2119b85411852cf681bf9fbc4f5f358df624b7a98888ee23880"
	I1028 17:50:28.067734  215146 cri.go:89] found id: "f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1"
	I1028 17:50:28.067738  215146 cri.go:89] found id: "48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420"
	I1028 17:50:28.067741  215146 cri.go:89] found id: "e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98"
	I1028 17:50:28.067744  215146 cri.go:89] found id: "07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45"
	I1028 17:50:28.067748  215146 cri.go:89] found id: "c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2"
	I1028 17:50:28.067751  215146 cri.go:89] found id: ""
	I1028 17:50:28.067812  215146 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I1028 17:50:28.086566  215146 cri.go:116] JSON = null
	W1028 17:50:28.086645  215146 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
	I1028 17:50:28.086741  215146 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I1028 17:50:28.098259  215146 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I1028 17:50:28.098284  215146 kubeadm.go:593] restartPrimaryControlPlane start ...
	I1028 17:50:28.098349  215146 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I1028 17:50:28.108519  215146 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I1028 17:50:28.109024  215146 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-743648" does not appear in /home/jenkins/minikube-integration/19872-2421/kubeconfig
	I1028 17:50:28.109143  215146 kubeconfig.go:62] /home/jenkins/minikube-integration/19872-2421/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-743648" cluster setting kubeconfig missing "old-k8s-version-743648" context setting]
	I1028 17:50:28.109514  215146 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19872-2421/kubeconfig: {Name:mk5d0caa294b9d2ca80eaff01c0ffe9a532db746 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 17:50:28.111227  215146 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I1028 17:50:28.121702  215146 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
	I1028 17:50:28.121755  215146 kubeadm.go:597] duration metric: took 23.465225ms to restartPrimaryControlPlane
	I1028 17:50:28.121767  215146 kubeadm.go:394] duration metric: took 128.101744ms to StartCluster
	I1028 17:50:28.121782  215146 settings.go:142] acquiring lock: {Name:mk543e20b5eb6c4236b6d62e05ff811d7fc9498d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 17:50:28.121857  215146 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19872-2421/kubeconfig
	I1028 17:50:28.122570  215146 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19872-2421/kubeconfig: {Name:mk5d0caa294b9d2ca80eaff01c0ffe9a532db746 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 17:50:28.122839  215146 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I1028 17:50:28.123067  215146 config.go:182] Loaded profile config "old-k8s-version-743648": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I1028 17:50:28.123184  215146 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I1028 17:50:28.123362  215146 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-743648"
	I1028 17:50:28.123383  215146 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-743648"
	W1028 17:50:28.123390  215146 addons.go:243] addon storage-provisioner should already be in state true
	I1028 17:50:28.123430  215146 host.go:66] Checking if "old-k8s-version-743648" exists ...
	I1028 17:50:28.123450  215146 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-743648"
	I1028 17:50:28.123473  215146 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-743648"
	I1028 17:50:28.123767  215146 cli_runner.go:164] Run: docker container inspect old-k8s-version-743648 --format={{.State.Status}}
	I1028 17:50:28.124122  215146 cli_runner.go:164] Run: docker container inspect old-k8s-version-743648 --format={{.State.Status}}
	I1028 17:50:28.124591  215146 addons.go:69] Setting dashboard=true in profile "old-k8s-version-743648"
	I1028 17:50:28.124612  215146 addons.go:234] Setting addon dashboard=true in "old-k8s-version-743648"
	W1028 17:50:28.124623  215146 addons.go:243] addon dashboard should already be in state true
	I1028 17:50:28.124661  215146 host.go:66] Checking if "old-k8s-version-743648" exists ...
	I1028 17:50:28.125164  215146 cli_runner.go:164] Run: docker container inspect old-k8s-version-743648 --format={{.State.Status}}
	I1028 17:50:28.126056  215146 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-743648"
	I1028 17:50:28.126083  215146 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-743648"
	W1028 17:50:28.126091  215146 addons.go:243] addon metrics-server should already be in state true
	I1028 17:50:28.126170  215146 host.go:66] Checking if "old-k8s-version-743648" exists ...
	I1028 17:50:28.126628  215146 cli_runner.go:164] Run: docker container inspect old-k8s-version-743648 --format={{.State.Status}}
	I1028 17:50:28.137406  215146 out.go:177] * Verifying Kubernetes components...
	I1028 17:50:28.139953  215146 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 17:50:28.187914  215146 out.go:177]   - Using image docker.io/kubernetesui/dashboard:v2.7.0
	I1028 17:50:28.190730  215146 out.go:177]   - Using image registry.k8s.io/echoserver:1.4
	I1028 17:50:28.192611  215146 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-743648"
	W1028 17:50:28.192632  215146 addons.go:243] addon default-storageclass should already be in state true
	I1028 17:50:28.192659  215146 host.go:66] Checking if "old-k8s-version-743648" exists ...
	I1028 17:50:28.193059  215146 cli_runner.go:164] Run: docker container inspect old-k8s-version-743648 --format={{.State.Status}}
	I1028 17:50:28.199067  215146 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I1028 17:50:28.199143  215146 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I1028 17:50:28.199244  215146 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-743648
	I1028 17:50:28.204230  215146 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 17:50:28.206757  215146 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 17:50:28.206780  215146 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I1028 17:50:28.206848  215146 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-743648
	I1028 17:50:28.219997  215146 out.go:177]   - Using image fake.domain/registry.k8s.io/echoserver:1.4
	I1028 17:50:28.222372  215146 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I1028 17:50:28.222399  215146 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I1028 17:50:28.222479  215146 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-743648
	I1028 17:50:28.252463  215146 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I1028 17:50:28.252487  215146 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I1028 17:50:28.252582  215146 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-743648
	I1028 17:50:28.272824  215146 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33066 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/old-k8s-version-743648/id_rsa Username:docker}
	I1028 17:50:28.296878  215146 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33066 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/old-k8s-version-743648/id_rsa Username:docker}
	I1028 17:50:28.314411  215146 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33066 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/old-k8s-version-743648/id_rsa Username:docker}
	I1028 17:50:28.316947  215146 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33066 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/old-k8s-version-743648/id_rsa Username:docker}
	I1028 17:50:28.401918  215146 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I1028 17:50:28.418273  215146 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-743648" to be "Ready" ...
	I1028 17:50:28.456199  215146 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I1028 17:50:28.456294  215146 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I1028 17:50:28.476010  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 17:50:28.490282  215146 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I1028 17:50:28.490310  215146 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I1028 17:50:28.508219  215146 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I1028 17:50:28.508243  215146 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
	I1028 17:50:28.536746  215146 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I1028 17:50:28.536785  215146 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I1028 17:50:28.557390  215146 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I1028 17:50:28.557418  215146 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I1028 17:50:28.588510  215146 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I1028 17:50:28.588537  215146 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
	I1028 17:50:28.609714  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I1028 17:50:28.621226  215146 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I1028 17:50:28.621256  215146 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I1028 17:50:28.629204  215146 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
	I1028 17:50:28.629250  215146 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I1028 17:50:28.685481  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W1028 17:50:28.713024  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:28.713062  215146 retry.go:31] will retry after 249.641032ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:28.741295  215146 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I1028 17:50:28.741328  215146 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I1028 17:50:28.830152  215146 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I1028 17:50:28.830199  215146 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	W1028 17:50:28.886072  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:28.886147  215146 retry.go:31] will retry after 157.628194ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:28.891784  215146 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I1028 17:50:28.891813  215146 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	W1028 17:50:28.904689  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:28.904763  215146 retry.go:31] will retry after 300.814665ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:28.917285  215146 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I1028 17:50:28.917360  215146 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I1028 17:50:28.947169  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I1028 17:50:28.963868  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 17:50:29.044662  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W1028 17:50:29.115101  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:29.115132  215146 retry.go:31] will retry after 345.572336ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W1028 17:50:29.137402  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:29.137436  215146 retry.go:31] will retry after 367.037177ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W1028 17:50:29.197950  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:29.197984  215146 retry.go:31] will retry after 325.458493ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:29.206201  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W1028 17:50:29.292946  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:29.292977  215146 retry.go:31] will retry after 234.008781ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:29.461927  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I1028 17:50:29.505389  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 17:50:29.523707  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I1028 17:50:29.528060  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W1028 17:50:29.587711  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:29.587745  215146 retry.go:31] will retry after 548.105078ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W1028 17:50:29.836531  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:29.836573  215146 retry.go:31] will retry after 367.821073ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W1028 17:50:29.836619  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:29.836632  215146 retry.go:31] will retry after 333.119268ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W1028 17:50:29.836668  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:29.836690  215146 retry.go:31] will retry after 828.737205ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:30.136915  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I1028 17:50:30.170416  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I1028 17:50:30.205393  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W1028 17:50:30.336214  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:30.336296  215146 retry.go:31] will retry after 639.459882ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W1028 17:50:30.360681  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:30.360762  215146 retry.go:31] will retry after 1.190321719s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W1028 17:50:30.412425  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:30.412502  215146 retry.go:31] will retry after 1.012067697s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:30.419100  215146 node_ready.go:53] error getting node "old-k8s-version-743648": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-743648": dial tcp 192.168.76.2:8443: connect: connection refused
	I1028 17:50:30.665613  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W1028 17:50:30.781004  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:30.781083  215146 retry.go:31] will retry after 867.401968ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:30.976846  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W1028 17:50:31.068059  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:31.068143  215146 retry.go:31] will retry after 1.092810424s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:31.425025  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W1028 17:50:31.522227  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:31.522311  215146 retry.go:31] will retry after 1.275349181s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:31.551373  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W1028 17:50:31.645069  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:31.645103  215146 retry.go:31] will retry after 709.215568ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:31.649248  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W1028 17:50:31.726052  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:31.726137  215146 retry.go:31] will retry after 1.661237295s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:32.161144  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W1028 17:50:32.247356  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:32.247387  215146 retry.go:31] will retry after 1.31242894s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:32.354533  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I1028 17:50:32.419190  215146 node_ready.go:53] error getting node "old-k8s-version-743648": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-743648": dial tcp 192.168.76.2:8443: connect: connection refused
	W1028 17:50:32.452586  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:32.452644  215146 retry.go:31] will retry after 2.038100899s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:32.797995  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W1028 17:50:32.912184  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:32.912222  215146 retry.go:31] will retry after 1.885176329s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:33.388083  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W1028 17:50:33.482581  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:33.482643  215146 retry.go:31] will retry after 1.530141348s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:33.560967  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W1028 17:50:33.649774  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:33.649821  215146 retry.go:31] will retry after 2.539342723s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:34.490985  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W1028 17:50:34.632178  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:34.632225  215146 retry.go:31] will retry after 1.855325231s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:34.798452  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 17:50:34.920943  215146 node_ready.go:53] error getting node "old-k8s-version-743648": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-743648": dial tcp 192.168.76.2:8443: connect: connection refused
	W1028 17:50:34.962865  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:34.962901  215146 retry.go:31] will retry after 4.162380121s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:35.013422  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W1028 17:50:35.269762  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:35.269799  215146 retry.go:31] will retry after 1.625161206s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:36.189781  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W1028 17:50:36.329959  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:36.329994  215146 retry.go:31] will retry after 2.176317677s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:36.488671  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W1028 17:50:36.584628  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:36.584657  215146 retry.go:31] will retry after 2.387194881s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:36.895110  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W1028 17:50:37.243890  215146 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:37.243921  215146 retry.go:31] will retry after 5.415643272s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I1028 17:50:37.419564  215146 node_ready.go:53] error getting node "old-k8s-version-743648": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-743648": dial tcp 192.168.76.2:8443: connect: connection refused
	I1028 17:50:38.506668  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I1028 17:50:38.972305  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I1028 17:50:39.125675  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 17:50:42.659692  215146 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I1028 17:50:47.920762  215146 node_ready.go:53] error getting node "old-k8s-version-743648": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-743648": net/http: TLS handshake timeout
	I1028 17:50:48.831124  215146 node_ready.go:49] node "old-k8s-version-743648" has status "Ready":"True"
	I1028 17:50:48.831148  215146 node_ready.go:38] duration metric: took 20.412804956s for node "old-k8s-version-743648" to be "Ready" ...
	I1028 17:50:48.831158  215146 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I1028 17:50:49.092405  215146 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-97b6q" in "kube-system" namespace to be "Ready" ...
	I1028 17:50:49.318060  215146 pod_ready.go:93] pod "coredns-74ff55c5b-97b6q" in "kube-system" namespace has status "Ready":"True"
	I1028 17:50:49.318141  215146 pod_ready.go:82] duration metric: took 225.651749ms for pod "coredns-74ff55c5b-97b6q" in "kube-system" namespace to be "Ready" ...
	I1028 17:50:49.318167  215146 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-743648" in "kube-system" namespace to be "Ready" ...
	I1028 17:50:49.350075  215146 pod_ready.go:98] node "old-k8s-version-743648" hosting pod "etcd-old-k8s-version-743648" in "kube-system" namespace is currently not "Ready" (skipping!): node "old-k8s-version-743648" has status "Ready":"False"
	I1028 17:50:49.350150  215146 pod_ready.go:82] duration metric: took 31.951746ms for pod "etcd-old-k8s-version-743648" in "kube-system" namespace to be "Ready" ...
	E1028 17:50:49.350176  215146 pod_ready.go:67] WaitExtra: waitPodCondition: node "old-k8s-version-743648" hosting pod "etcd-old-k8s-version-743648" in "kube-system" namespace is currently not "Ready" (skipping!): node "old-k8s-version-743648" has status "Ready":"False"
	I1028 17:50:49.350215  215146 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-743648" in "kube-system" namespace to be "Ready" ...
	I1028 17:50:51.359742  215146 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (12.853025386s)
	I1028 17:50:51.359959  215146 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (12.387626569s)
	I1028 17:50:51.360100  215146 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (12.234385234s)
	I1028 17:50:51.361965  215146 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p old-k8s-version-743648 addons enable metrics-server
	
	I1028 17:50:51.517262  215146 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:50:51.597447  215146 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.937713322s)
	I1028 17:50:51.597481  215146 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-743648"
	I1028 17:50:51.600514  215146 out.go:177] * Enabled addons: storage-provisioner, dashboard, default-storageclass, metrics-server
	I1028 17:50:51.602561  215146 addons.go:510] duration metric: took 23.47935473s for enable addons: enabled=[storage-provisioner dashboard default-storageclass metrics-server]
	I1028 17:50:53.857965  215146 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:50:56.357489  215146 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:50:58.358957  215146 pod_ready.go:103] pod "kube-apiserver-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:00.364808  215146 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"True"
	I1028 17:51:00.364901  215146 pod_ready.go:82] duration metric: took 11.014611858s for pod "kube-apiserver-old-k8s-version-743648" in "kube-system" namespace to be "Ready" ...
	I1028 17:51:00.364932  215146 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace to be "Ready" ...
	I1028 17:51:02.372272  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:04.873398  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:07.371522  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:09.372719  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:11.380138  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:13.874201  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:16.373263  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:18.872080  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:21.371191  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:23.371478  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:25.871341  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:27.873185  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:30.371410  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:32.871590  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:34.872705  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:37.371451  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:39.371516  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:41.871268  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:43.872531  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:46.373840  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:48.871980  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:51.371966  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:53.871867  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:56.371855  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:58.372925  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:00.382717  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:01.374686  215146 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"True"
	I1028 17:52:01.374713  215146 pod_ready.go:82] duration metric: took 1m1.009759232s for pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:01.374725  215146 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-zzhjw" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:01.380398  215146 pod_ready.go:93] pod "kube-proxy-zzhjw" in "kube-system" namespace has status "Ready":"True"
	I1028 17:52:01.380426  215146 pod_ready.go:82] duration metric: took 5.693725ms for pod "kube-proxy-zzhjw" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:01.380438  215146 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-743648" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:03.386921  215146 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:05.387165  215146 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:07.887839  215146 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:09.396099  215146 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"True"
	I1028 17:52:09.396169  215146 pod_ready.go:82] duration metric: took 8.015721675s for pod "kube-scheduler-old-k8s-version-743648" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:09.396196  215146 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:11.403439  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:13.903256  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:15.905755  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:18.402603  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:20.409296  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:22.903578  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:25.403212  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:27.903456  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:30.402618  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:32.903183  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:35.402894  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:37.402921  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:39.407728  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:41.902217  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:43.902841  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:46.402949  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:48.403172  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:50.902528  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:52.904605  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:55.401888  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:57.404216  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:59.901848  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:01.902156  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:03.903376  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:06.404303  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:08.904591  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:11.402296  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:13.903797  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:16.402739  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:18.903188  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:21.401986  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:23.402635  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:25.902538  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:27.902722  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:29.903115  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:31.903725  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:34.403587  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:36.403772  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:38.903738  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:41.401810  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:43.404321  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:45.404851  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:47.902832  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:49.903288  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:52.403120  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:54.902750  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:56.902993  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:59.403935  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:01.405887  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:03.902918  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:06.402740  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:08.901955  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:10.903113  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:13.404332  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:15.901937  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:17.903008  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:19.903497  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:22.402932  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:24.903029  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:27.402751  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:29.408164  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:31.902254  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:33.902654  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:36.403234  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:38.902989  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:41.403337  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:43.904604  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:45.911071  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:48.402130  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:50.402970  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:52.904597  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:55.402156  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:57.402401  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:59.409121  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:01.902400  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:03.902455  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:05.902611  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:07.903035  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:10.403203  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:12.902646  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:14.904525  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:17.403120  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:19.403710  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:21.902564  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:24.403100  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:26.902735  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:28.902857  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:31.402331  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:33.402846  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:35.902772  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:37.908704  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:40.402250  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:42.403352  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:44.902191  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:46.902393  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:48.902433  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:51.402737  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:53.903135  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:55.904316  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:58.403625  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:00.427009  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:02.902449  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:04.903621  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:06.904653  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:09.402306  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:09.402337  215146 pod_ready.go:82] duration metric: took 4m0.00611291s for pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace to be "Ready" ...
	E1028 17:56:09.402348  215146 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
	I1028 17:56:09.402356  215146 pod_ready.go:39] duration metric: took 5m20.571187986s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I1028 17:56:09.402371  215146 api_server.go:52] waiting for apiserver process to appear ...
	I1028 17:56:09.402405  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I1028 17:56:09.402471  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I1028 17:56:09.448538  215146 cri.go:89] found id: "be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6"
	I1028 17:56:09.448610  215146 cri.go:89] found id: "c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2"
	I1028 17:56:09.448617  215146 cri.go:89] found id: ""
	I1028 17:56:09.448624  215146 logs.go:282] 2 containers: [be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6 c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2]
	I1028 17:56:09.448679  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.453245  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.456632  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I1028 17:56:09.456702  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I1028 17:56:09.501220  215146 cri.go:89] found id: "ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80"
	I1028 17:56:09.501288  215146 cri.go:89] found id: "48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420"
	I1028 17:56:09.501299  215146 cri.go:89] found id: ""
	I1028 17:56:09.501307  215146 logs.go:282] 2 containers: [ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80 48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420]
	I1028 17:56:09.501362  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.505290  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.508437  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I1028 17:56:09.508530  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I1028 17:56:09.550712  215146 cri.go:89] found id: "0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522"
	I1028 17:56:09.550740  215146 cri.go:89] found id: "697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e"
	I1028 17:56:09.550748  215146 cri.go:89] found id: ""
	I1028 17:56:09.550756  215146 logs.go:282] 2 containers: [0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522 697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e]
	I1028 17:56:09.550814  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.554604  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.558130  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I1028 17:56:09.558217  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I1028 17:56:09.596423  215146 cri.go:89] found id: "0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca"
	I1028 17:56:09.596441  215146 cri.go:89] found id: "e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98"
	I1028 17:56:09.596446  215146 cri.go:89] found id: ""
	I1028 17:56:09.596453  215146 logs.go:282] 2 containers: [0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98]
	I1028 17:56:09.596506  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.603505  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.607560  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I1028 17:56:09.607627  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I1028 17:56:09.644117  215146 cri.go:89] found id: "251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b"
	I1028 17:56:09.644141  215146 cri.go:89] found id: "f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1"
	I1028 17:56:09.644146  215146 cri.go:89] found id: ""
	I1028 17:56:09.644153  215146 logs.go:282] 2 containers: [251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1]
	I1028 17:56:09.644207  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.647803  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.651052  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I1028 17:56:09.651119  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I1028 17:56:09.691655  215146 cri.go:89] found id: "45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6"
	I1028 17:56:09.691683  215146 cri.go:89] found id: "07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45"
	I1028 17:56:09.691687  215146 cri.go:89] found id: ""
	I1028 17:56:09.691694  215146 logs.go:282] 2 containers: [45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6 07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45]
	I1028 17:56:09.691755  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.695508  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.699134  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I1028 17:56:09.699244  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I1028 17:56:09.738913  215146 cri.go:89] found id: "281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572"
	I1028 17:56:09.738939  215146 cri.go:89] found id: "eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d"
	I1028 17:56:09.738944  215146 cri.go:89] found id: ""
	I1028 17:56:09.738951  215146 logs.go:282] 2 containers: [281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572 eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d]
	I1028 17:56:09.739019  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.742717  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.746117  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I1028 17:56:09.746199  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I1028 17:56:09.784046  215146 cri.go:89] found id: "616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245"
	I1028 17:56:09.784070  215146 cri.go:89] found id: ""
	I1028 17:56:09.784078  215146 logs.go:282] 1 containers: [616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245]
	I1028 17:56:09.784132  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.787696  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I1028 17:56:09.787759  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I1028 17:56:09.835450  215146 cri.go:89] found id: "1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220"
	I1028 17:56:09.835472  215146 cri.go:89] found id: "7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78"
	I1028 17:56:09.835477  215146 cri.go:89] found id: ""
	I1028 17:56:09.835484  215146 logs.go:282] 2 containers: [1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220 7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78]
	I1028 17:56:09.835550  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.839920  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.844047  215146 logs.go:123] Gathering logs for coredns [0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522] ...
	I1028 17:56:09.844069  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522"
	I1028 17:56:09.887075  215146 logs.go:123] Gathering logs for kube-proxy [251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b] ...
	I1028 17:56:09.887100  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b"
	I1028 17:56:09.930757  215146 logs.go:123] Gathering logs for kube-controller-manager [45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6] ...
	I1028 17:56:09.930786  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6"
	I1028 17:56:09.989516  215146 logs.go:123] Gathering logs for kube-controller-manager [07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45] ...
	I1028 17:56:09.989550  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45"
	I1028 17:56:10.075876  215146 logs.go:123] Gathering logs for storage-provisioner [1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220] ...
	I1028 17:56:10.075913  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220"
	I1028 17:56:10.131752  215146 logs.go:123] Gathering logs for container status ...
	I1028 17:56:10.131782  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 17:56:10.189774  215146 logs.go:123] Gathering logs for kubelet ...
	I1028 17:56:10.189811  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W1028 17:56:10.260140  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.823989     666 reflector.go:138] object-"kube-system"/"metrics-server-token-s8546": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-s8546" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.260375  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.825360     666 reflector.go:138] object-"kube-system"/"kindnet-token-rzkm7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-rzkm7" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.260691  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.826686     666 reflector.go:138] object-"kube-system"/"coredns-token-bhrx5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-bhrx5" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.260895  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.827119     666 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.261159  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.827457     666 reflector.go:138] object-"kube-system"/"kube-proxy-token-j55lg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-j55lg" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.263578  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.862535     666 reflector.go:138] object-"kube-system"/"storage-provisioner-token-42rw4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-42rw4" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.263789  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.862690     666 reflector.go:138] object-"default"/"default-token-8g42r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-8g42r" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.265241  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.862027     666 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.273845  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:52 old-k8s-version-743648 kubelet[666]: E1028 17:50:52.034873     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:10.274042  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:52 old-k8s-version-743648 kubelet[666]: E1028 17:50:52.426336     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.276900  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:04 old-k8s-version-743648 kubelet[666]: E1028 17:51:04.181734     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:10.278592  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:15 old-k8s-version-743648 kubelet[666]: E1028 17:51:15.145992     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.279523  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:20 old-k8s-version-743648 kubelet[666]: E1028 17:51:20.589441     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.279852  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:21 old-k8s-version-743648 kubelet[666]: E1028 17:51:21.593639     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.280289  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:23 old-k8s-version-743648 kubelet[666]: E1028 17:51:23.609906     666 pod_workers.go:191] Error syncing pod 8ffc3abd-c784-474f-80a5-f6a8b25abc51 ("storage-provisioner_kube-system(8ffc3abd-c784-474f-80a5-f6a8b25abc51)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(8ffc3abd-c784-474f-80a5-f6a8b25abc51)"
	W1028 17:56:10.280628  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:25 old-k8s-version-743648 kubelet[666]: E1028 17:51:25.775266     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.283444  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:29 old-k8s-version-743648 kubelet[666]: E1028 17:51:29.147486     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:10.283892  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:41 old-k8s-version-743648 kubelet[666]: E1028 17:51:41.138852     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.284352  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:41 old-k8s-version-743648 kubelet[666]: E1028 17:51:41.660884     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.284688  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:45 old-k8s-version-743648 kubelet[666]: E1028 17:51:45.774632     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.284874  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:52 old-k8s-version-743648 kubelet[666]: E1028 17:51:52.138242     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.285204  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:59 old-k8s-version-743648 kubelet[666]: E1028 17:51:59.137591     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.285395  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:05 old-k8s-version-743648 kubelet[666]: E1028 17:52:05.138208     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.285982  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:14 old-k8s-version-743648 kubelet[666]: E1028 17:52:14.756224     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.286310  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:15 old-k8s-version-743648 kubelet[666]: E1028 17:52:15.774720     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.288793  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:17 old-k8s-version-743648 kubelet[666]: E1028 17:52:17.148693     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:10.289126  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:28 old-k8s-version-743648 kubelet[666]: E1028 17:52:28.141800     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.289309  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:32 old-k8s-version-743648 kubelet[666]: E1028 17:52:32.138343     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.289637  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:40 old-k8s-version-743648 kubelet[666]: E1028 17:52:40.138205     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.289820  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:44 old-k8s-version-743648 kubelet[666]: E1028 17:52:44.140775     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.290404  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:55 old-k8s-version-743648 kubelet[666]: E1028 17:52:55.867579     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.290588  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:58 old-k8s-version-743648 kubelet[666]: E1028 17:52:58.138213     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.290916  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:05 old-k8s-version-743648 kubelet[666]: E1028 17:53:05.775406     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.291101  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:13 old-k8s-version-743648 kubelet[666]: E1028 17:53:13.138098     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.291427  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:17 old-k8s-version-743648 kubelet[666]: E1028 17:53:17.137660     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.291608  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:25 old-k8s-version-743648 kubelet[666]: E1028 17:53:25.138080     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.291950  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:28 old-k8s-version-743648 kubelet[666]: E1028 17:53:28.141572     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.294378  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:39 old-k8s-version-743648 kubelet[666]: E1028 17:53:39.147007     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:10.294718  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:43 old-k8s-version-743648 kubelet[666]: E1028 17:53:43.137608     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.294904  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:52 old-k8s-version-743648 kubelet[666]: E1028 17:53:52.138963     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.295229  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:57 old-k8s-version-743648 kubelet[666]: E1028 17:53:57.137666     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.295414  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:03 old-k8s-version-743648 kubelet[666]: E1028 17:54:03.139810     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.295738  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:08 old-k8s-version-743648 kubelet[666]: E1028 17:54:08.137748     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.295926  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:15 old-k8s-version-743648 kubelet[666]: E1028 17:54:15.138210     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.296514  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:22 old-k8s-version-743648 kubelet[666]: E1028 17:54:22.110858     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.296852  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:25 old-k8s-version-743648 kubelet[666]: E1028 17:54:25.774510     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.297038  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:26 old-k8s-version-743648 kubelet[666]: E1028 17:54:26.142477     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.297362  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:36 old-k8s-version-743648 kubelet[666]: E1028 17:54:36.140263     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.297545  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:40 old-k8s-version-743648 kubelet[666]: E1028 17:54:40.138696     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.297872  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:51 old-k8s-version-743648 kubelet[666]: E1028 17:54:51.137643     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.298055  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:54 old-k8s-version-743648 kubelet[666]: E1028 17:54:54.140745     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.298386  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:05 old-k8s-version-743648 kubelet[666]: E1028 17:55:05.137675     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.298570  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:06 old-k8s-version-743648 kubelet[666]: E1028 17:55:06.141555     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.298895  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:18 old-k8s-version-743648 kubelet[666]: E1028 17:55:18.142304     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.299079  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:18 old-k8s-version-743648 kubelet[666]: E1028 17:55:18.144881     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.299262  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:30 old-k8s-version-743648 kubelet[666]: E1028 17:55:30.145457     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.299586  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:30 old-k8s-version-743648 kubelet[666]: E1028 17:55:30.148252     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.299910  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.143236     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.300093  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.149385     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.300421  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:56 old-k8s-version-743648 kubelet[666]: E1028 17:55:56.138548     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.300632  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:59 old-k8s-version-743648 kubelet[666]: E1028 17:55:59.138036     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I1028 17:56:10.300643  215146 logs.go:123] Gathering logs for describe nodes ...
	I1028 17:56:10.300657  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 17:56:10.461900  215146 logs.go:123] Gathering logs for etcd [ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80] ...
	I1028 17:56:10.461929  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80"
	I1028 17:56:10.543636  215146 logs.go:123] Gathering logs for etcd [48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420] ...
	I1028 17:56:10.543667  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420"
	I1028 17:56:10.596502  215146 logs.go:123] Gathering logs for kube-scheduler [0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca] ...
	I1028 17:56:10.596534  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca"
	I1028 17:56:10.668010  215146 logs.go:123] Gathering logs for kube-proxy [f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1] ...
	I1028 17:56:10.668084  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1"
	I1028 17:56:10.718076  215146 logs.go:123] Gathering logs for containerd ...
	I1028 17:56:10.718154  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I1028 17:56:10.799093  215146 logs.go:123] Gathering logs for dmesg ...
	I1028 17:56:10.799138  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 17:56:10.817662  215146 logs.go:123] Gathering logs for kube-apiserver [c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2] ...
	I1028 17:56:10.817695  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2"
	I1028 17:56:10.898218  215146 logs.go:123] Gathering logs for kindnet [eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d] ...
	I1028 17:56:10.898249  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d"
	I1028 17:56:10.949120  215146 logs.go:123] Gathering logs for kubernetes-dashboard [616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245] ...
	I1028 17:56:10.949162  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245"
	I1028 17:56:11.003335  215146 logs.go:123] Gathering logs for kube-apiserver [be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6] ...
	I1028 17:56:11.003364  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6"
	I1028 17:56:11.097068  215146 logs.go:123] Gathering logs for kindnet [281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572] ...
	I1028 17:56:11.097153  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572"
	I1028 17:56:11.199799  215146 logs.go:123] Gathering logs for storage-provisioner [7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78] ...
	I1028 17:56:11.199905  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78"
	I1028 17:56:11.294982  215146 logs.go:123] Gathering logs for coredns [697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e] ...
	I1028 17:56:11.295052  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e"
	I1028 17:56:11.350232  215146 logs.go:123] Gathering logs for kube-scheduler [e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98] ...
	I1028 17:56:11.350305  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98"
	I1028 17:56:11.409560  215146 out.go:358] Setting ErrFile to fd 2...
	I1028 17:56:11.409639  215146 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W1028 17:56:11.409735  215146 out.go:270] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W1028 17:56:11.409781  215146 out.go:270]   Oct 28 17:55:30 old-k8s-version-743648 kubelet[666]: E1028 17:55:30.148252     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	  Oct 28 17:55:30 old-k8s-version-743648 kubelet[666]: E1028 17:55:30.148252     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:11.409949  215146 out.go:270]   Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.143236     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	  Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.143236     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:11.409983  215146 out.go:270]   Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.149385     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.149385     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:11.410035  215146 out.go:270]   Oct 28 17:55:56 old-k8s-version-743648 kubelet[666]: E1028 17:55:56.138548     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	  Oct 28 17:55:56 old-k8s-version-743648 kubelet[666]: E1028 17:55:56.138548     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:11.410082  215146 out.go:270]   Oct 28 17:55:59 old-k8s-version-743648 kubelet[666]: E1028 17:55:59.138036     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Oct 28 17:55:59 old-k8s-version-743648 kubelet[666]: E1028 17:55:59.138036     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I1028 17:56:11.410132  215146 out.go:358] Setting ErrFile to fd 2...
	I1028 17:56:11.410153  215146 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:56:21.411726  215146 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 17:56:21.424434  215146 api_server.go:72] duration metric: took 5m53.301552069s to wait for apiserver process to appear ...
	I1028 17:56:21.424458  215146 api_server.go:88] waiting for apiserver healthz status ...
	I1028 17:56:21.424495  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I1028 17:56:21.424586  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I1028 17:56:21.462686  215146 cri.go:89] found id: "be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6"
	I1028 17:56:21.462708  215146 cri.go:89] found id: "c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2"
	I1028 17:56:21.462713  215146 cri.go:89] found id: ""
	I1028 17:56:21.462721  215146 logs.go:282] 2 containers: [be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6 c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2]
	I1028 17:56:21.462783  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.466844  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.477116  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I1028 17:56:21.477193  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I1028 17:56:21.528404  215146 cri.go:89] found id: "ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80"
	I1028 17:56:21.528424  215146 cri.go:89] found id: "48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420"
	I1028 17:56:21.528429  215146 cri.go:89] found id: ""
	I1028 17:56:21.528436  215146 logs.go:282] 2 containers: [ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80 48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420]
	I1028 17:56:21.528490  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.532483  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.536429  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I1028 17:56:21.536503  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I1028 17:56:21.577695  215146 cri.go:89] found id: "0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522"
	I1028 17:56:21.577724  215146 cri.go:89] found id: "697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e"
	I1028 17:56:21.577729  215146 cri.go:89] found id: ""
	I1028 17:56:21.577737  215146 logs.go:282] 2 containers: [0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522 697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e]
	I1028 17:56:21.577814  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.581875  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.585396  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I1028 17:56:21.585469  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I1028 17:56:21.626201  215146 cri.go:89] found id: "0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca"
	I1028 17:56:21.626225  215146 cri.go:89] found id: "e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98"
	I1028 17:56:21.626230  215146 cri.go:89] found id: ""
	I1028 17:56:21.626237  215146 logs.go:282] 2 containers: [0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98]
	I1028 17:56:21.626295  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.629990  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.633594  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I1028 17:56:21.633663  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I1028 17:56:21.676659  215146 cri.go:89] found id: "251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b"
	I1028 17:56:21.676682  215146 cri.go:89] found id: "f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1"
	I1028 17:56:21.676687  215146 cri.go:89] found id: ""
	I1028 17:56:21.676694  215146 logs.go:282] 2 containers: [251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1]
	I1028 17:56:21.676753  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.681207  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.684753  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I1028 17:56:21.684826  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I1028 17:56:21.758221  215146 cri.go:89] found id: "45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6"
	I1028 17:56:21.758242  215146 cri.go:89] found id: "07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45"
	I1028 17:56:21.758247  215146 cri.go:89] found id: ""
	I1028 17:56:21.758254  215146 logs.go:282] 2 containers: [45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6 07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45]
	I1028 17:56:21.758309  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.762388  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.765992  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I1028 17:56:21.766050  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I1028 17:56:21.815014  215146 cri.go:89] found id: "281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572"
	I1028 17:56:21.815040  215146 cri.go:89] found id: "eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d"
	I1028 17:56:21.815045  215146 cri.go:89] found id: ""
	I1028 17:56:21.815052  215146 logs.go:282] 2 containers: [281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572 eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d]
	I1028 17:56:21.815108  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.818748  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.822240  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I1028 17:56:21.822340  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I1028 17:56:21.865838  215146 cri.go:89] found id: "616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245"
	I1028 17:56:21.865901  215146 cri.go:89] found id: ""
	I1028 17:56:21.865916  215146 logs.go:282] 1 containers: [616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245]
	I1028 17:56:21.865971  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.870830  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I1028 17:56:21.870949  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I1028 17:56:21.910658  215146 cri.go:89] found id: "1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220"
	I1028 17:56:21.910685  215146 cri.go:89] found id: "7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78"
	I1028 17:56:21.910689  215146 cri.go:89] found id: ""
	I1028 17:56:21.910699  215146 logs.go:282] 2 containers: [1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220 7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78]
	I1028 17:56:21.910774  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.914374  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.917740  215146 logs.go:123] Gathering logs for kube-scheduler [e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98] ...
	I1028 17:56:21.917766  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98"
	I1028 17:56:21.958055  215146 logs.go:123] Gathering logs for kubernetes-dashboard [616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245] ...
	I1028 17:56:21.958089  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245"
	I1028 17:56:22.000135  215146 logs.go:123] Gathering logs for storage-provisioner [1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220] ...
	I1028 17:56:22.000162  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220"
	I1028 17:56:22.043187  215146 logs.go:123] Gathering logs for kubelet ...
	I1028 17:56:22.043217  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W1028 17:56:22.097360  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.823989     666 reflector.go:138] object-"kube-system"/"metrics-server-token-s8546": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-s8546" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.097593  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.825360     666 reflector.go:138] object-"kube-system"/"kindnet-token-rzkm7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-rzkm7" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.097805  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.826686     666 reflector.go:138] object-"kube-system"/"coredns-token-bhrx5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-bhrx5" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.098006  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.827119     666 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.098222  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.827457     666 reflector.go:138] object-"kube-system"/"kube-proxy-token-j55lg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-j55lg" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.100682  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.862535     666 reflector.go:138] object-"kube-system"/"storage-provisioner-token-42rw4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-42rw4" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.100895  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.862690     666 reflector.go:138] object-"default"/"default-token-8g42r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-8g42r" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.102299  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.862027     666 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.110663  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:52 old-k8s-version-743648 kubelet[666]: E1028 17:50:52.034873     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:22.110853  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:52 old-k8s-version-743648 kubelet[666]: E1028 17:50:52.426336     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.113643  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:04 old-k8s-version-743648 kubelet[666]: E1028 17:51:04.181734     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:22.115310  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:15 old-k8s-version-743648 kubelet[666]: E1028 17:51:15.145992     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.116227  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:20 old-k8s-version-743648 kubelet[666]: E1028 17:51:20.589441     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.116583  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:21 old-k8s-version-743648 kubelet[666]: E1028 17:51:21.593639     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.117028  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:23 old-k8s-version-743648 kubelet[666]: E1028 17:51:23.609906     666 pod_workers.go:191] Error syncing pod 8ffc3abd-c784-474f-80a5-f6a8b25abc51 ("storage-provisioner_kube-system(8ffc3abd-c784-474f-80a5-f6a8b25abc51)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(8ffc3abd-c784-474f-80a5-f6a8b25abc51)"
	W1028 17:56:22.117353  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:25 old-k8s-version-743648 kubelet[666]: E1028 17:51:25.775266     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.120160  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:29 old-k8s-version-743648 kubelet[666]: E1028 17:51:29.147486     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:22.120698  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:41 old-k8s-version-743648 kubelet[666]: E1028 17:51:41.138852     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.121161  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:41 old-k8s-version-743648 kubelet[666]: E1028 17:51:41.660884     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.121488  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:45 old-k8s-version-743648 kubelet[666]: E1028 17:51:45.774632     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.121670  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:52 old-k8s-version-743648 kubelet[666]: E1028 17:51:52.138242     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.121998  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:59 old-k8s-version-743648 kubelet[666]: E1028 17:51:59.137591     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.122182  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:05 old-k8s-version-743648 kubelet[666]: E1028 17:52:05.138208     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.122765  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:14 old-k8s-version-743648 kubelet[666]: E1028 17:52:14.756224     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.123092  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:15 old-k8s-version-743648 kubelet[666]: E1028 17:52:15.774720     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.125572  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:17 old-k8s-version-743648 kubelet[666]: E1028 17:52:17.148693     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:22.125906  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:28 old-k8s-version-743648 kubelet[666]: E1028 17:52:28.141800     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.126094  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:32 old-k8s-version-743648 kubelet[666]: E1028 17:52:32.138343     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.126423  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:40 old-k8s-version-743648 kubelet[666]: E1028 17:52:40.138205     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.126605  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:44 old-k8s-version-743648 kubelet[666]: E1028 17:52:44.140775     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.127190  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:55 old-k8s-version-743648 kubelet[666]: E1028 17:52:55.867579     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.127374  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:58 old-k8s-version-743648 kubelet[666]: E1028 17:52:58.138213     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.127698  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:05 old-k8s-version-743648 kubelet[666]: E1028 17:53:05.775406     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.127885  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:13 old-k8s-version-743648 kubelet[666]: E1028 17:53:13.138098     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.128213  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:17 old-k8s-version-743648 kubelet[666]: E1028 17:53:17.137660     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.128398  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:25 old-k8s-version-743648 kubelet[666]: E1028 17:53:25.138080     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.128741  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:28 old-k8s-version-743648 kubelet[666]: E1028 17:53:28.141572     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.131182  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:39 old-k8s-version-743648 kubelet[666]: E1028 17:53:39.147007     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:22.131510  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:43 old-k8s-version-743648 kubelet[666]: E1028 17:53:43.137608     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.131694  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:52 old-k8s-version-743648 kubelet[666]: E1028 17:53:52.138963     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.132018  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:57 old-k8s-version-743648 kubelet[666]: E1028 17:53:57.137666     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.132200  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:03 old-k8s-version-743648 kubelet[666]: E1028 17:54:03.139810     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.132523  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:08 old-k8s-version-743648 kubelet[666]: E1028 17:54:08.137748     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.132714  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:15 old-k8s-version-743648 kubelet[666]: E1028 17:54:15.138210     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.133317  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:22 old-k8s-version-743648 kubelet[666]: E1028 17:54:22.110858     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.133641  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:25 old-k8s-version-743648 kubelet[666]: E1028 17:54:25.774510     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.133824  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:26 old-k8s-version-743648 kubelet[666]: E1028 17:54:26.142477     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.134153  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:36 old-k8s-version-743648 kubelet[666]: E1028 17:54:36.140263     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.134335  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:40 old-k8s-version-743648 kubelet[666]: E1028 17:54:40.138696     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.134661  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:51 old-k8s-version-743648 kubelet[666]: E1028 17:54:51.137643     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.134843  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:54 old-k8s-version-743648 kubelet[666]: E1028 17:54:54.140745     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.135171  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:05 old-k8s-version-743648 kubelet[666]: E1028 17:55:05.137675     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.135355  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:06 old-k8s-version-743648 kubelet[666]: E1028 17:55:06.141555     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.135679  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:18 old-k8s-version-743648 kubelet[666]: E1028 17:55:18.142304     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.135860  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:18 old-k8s-version-743648 kubelet[666]: E1028 17:55:18.144881     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.136044  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:30 old-k8s-version-743648 kubelet[666]: E1028 17:55:30.145457     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.136368  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:30 old-k8s-version-743648 kubelet[666]: E1028 17:55:30.148252     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.136701  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.143236     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.136883  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.149385     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.137231  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:56 old-k8s-version-743648 kubelet[666]: E1028 17:55:56.138548     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.137419  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:59 old-k8s-version-743648 kubelet[666]: E1028 17:55:59.138036     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.137747  215146 logs.go:138] Found kubelet problem: Oct 28 17:56:11 old-k8s-version-743648 kubelet[666]: E1028 17:56:11.140245     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.137930  215146 logs.go:138] Found kubelet problem: Oct 28 17:56:13 old-k8s-version-743648 kubelet[666]: E1028 17:56:13.138081     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I1028 17:56:22.137946  215146 logs.go:123] Gathering logs for dmesg ...
	I1028 17:56:22.137960  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 17:56:22.158369  215146 logs.go:123] Gathering logs for kube-apiserver [be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6] ...
	I1028 17:56:22.158447  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6"
	I1028 17:56:22.213784  215146 logs.go:123] Gathering logs for kube-apiserver [c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2] ...
	I1028 17:56:22.213817  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2"
	I1028 17:56:22.279566  215146 logs.go:123] Gathering logs for coredns [0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522] ...
	I1028 17:56:22.279609  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522"
	I1028 17:56:22.320096  215146 logs.go:123] Gathering logs for storage-provisioner [7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78] ...
	I1028 17:56:22.320123  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78"
	I1028 17:56:22.366694  215146 logs.go:123] Gathering logs for kindnet [281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572] ...
	I1028 17:56:22.366732  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572"
	I1028 17:56:22.417133  215146 logs.go:123] Gathering logs for describe nodes ...
	I1028 17:56:22.417163  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 17:56:22.575425  215146 logs.go:123] Gathering logs for coredns [697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e] ...
	I1028 17:56:22.575457  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e"
	I1028 17:56:22.613582  215146 logs.go:123] Gathering logs for kube-proxy [251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b] ...
	I1028 17:56:22.613610  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b"
	I1028 17:56:22.660854  215146 logs.go:123] Gathering logs for kube-controller-manager [45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6] ...
	I1028 17:56:22.660882  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6"
	I1028 17:56:22.717997  215146 logs.go:123] Gathering logs for kube-controller-manager [07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45] ...
	I1028 17:56:22.718031  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45"
	I1028 17:56:22.775654  215146 logs.go:123] Gathering logs for etcd [ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80] ...
	I1028 17:56:22.775689  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80"
	I1028 17:56:22.829841  215146 logs.go:123] Gathering logs for etcd [48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420] ...
	I1028 17:56:22.829880  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420"
	I1028 17:56:22.873201  215146 logs.go:123] Gathering logs for kube-proxy [f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1] ...
	I1028 17:56:22.873231  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1"
	I1028 17:56:22.917373  215146 logs.go:123] Gathering logs for container status ...
	I1028 17:56:22.917399  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 17:56:22.966858  215146 logs.go:123] Gathering logs for kube-scheduler [0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca] ...
	I1028 17:56:22.966891  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca"
	I1028 17:56:23.010694  215146 logs.go:123] Gathering logs for kindnet [eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d] ...
	I1028 17:56:23.010731  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d"
	I1028 17:56:23.069106  215146 logs.go:123] Gathering logs for containerd ...
	I1028 17:56:23.069137  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I1028 17:56:23.132899  215146 out.go:358] Setting ErrFile to fd 2...
	I1028 17:56:23.132932  215146 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W1028 17:56:23.133001  215146 out.go:270] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W1028 17:56:23.133017  215146 out.go:270]   Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.149385     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.149385     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:23.133051  215146 out.go:270]   Oct 28 17:55:56 old-k8s-version-743648 kubelet[666]: E1028 17:55:56.138548     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	  Oct 28 17:55:56 old-k8s-version-743648 kubelet[666]: E1028 17:55:56.138548     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:23.133060  215146 out.go:270]   Oct 28 17:55:59 old-k8s-version-743648 kubelet[666]: E1028 17:55:59.138036     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Oct 28 17:55:59 old-k8s-version-743648 kubelet[666]: E1028 17:55:59.138036     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:23.133067  215146 out.go:270]   Oct 28 17:56:11 old-k8s-version-743648 kubelet[666]: E1028 17:56:11.140245     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	  Oct 28 17:56:11 old-k8s-version-743648 kubelet[666]: E1028 17:56:11.140245     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:23.133073  215146 out.go:270]   Oct 28 17:56:13 old-k8s-version-743648 kubelet[666]: E1028 17:56:13.138081     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Oct 28 17:56:13 old-k8s-version-743648 kubelet[666]: E1028 17:56:13.138081     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I1028 17:56:23.133082  215146 out.go:358] Setting ErrFile to fd 2...
	I1028 17:56:23.133089  215146 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:56:33.134758  215146 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I1028 17:56:33.146466  215146 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
	ok
	I1028 17:56:33.148907  215146 out.go:201] 
	W1028 17:56:33.150944  215146 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	W1028 17:56:33.150988  215146 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
	* Suggestion: Control Plane could not update, try minikube delete --all --purge
	W1028 17:56:33.151008  215146 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
	* Related issue: https://github.com/kubernetes/minikube/issues/11417
	W1028 17:56:33.151018  215146 out.go:270] * 
	* 
	W1028 17:56:33.151915  215146 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 17:56:33.154167  215146 out.go:201] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-743648 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect old-k8s-version-743648
helpers_test.go:235: (dbg) docker inspect old-k8s-version-743648:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "4c5718840b60fe074564d39fac7140a2cb2150b953d807efe276ee364039a882",
	        "Created": "2024-10-28T17:47:31.778560195Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 215428,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2024-10-28T17:50:20.505926588Z",
	            "FinishedAt": "2024-10-28T17:50:19.38112652Z"
	        },
	        "Image": "sha256:e93e681afec646b1183cc5ed9957e6950020eb724f4af8d4e63074eba4425a9d",
	        "ResolvConfPath": "/var/lib/docker/containers/4c5718840b60fe074564d39fac7140a2cb2150b953d807efe276ee364039a882/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/4c5718840b60fe074564d39fac7140a2cb2150b953d807efe276ee364039a882/hostname",
	        "HostsPath": "/var/lib/docker/containers/4c5718840b60fe074564d39fac7140a2cb2150b953d807efe276ee364039a882/hosts",
	        "LogPath": "/var/lib/docker/containers/4c5718840b60fe074564d39fac7140a2cb2150b953d807efe276ee364039a882/4c5718840b60fe074564d39fac7140a2cb2150b953d807efe276ee364039a882-json.log",
	        "Name": "/old-k8s-version-743648",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "old-k8s-version-743648:/var",
	                "/lib/modules:/lib/modules:ro"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "old-k8s-version-743648",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/e0d5fcf77ddad13b320c07bdc8bb7444961bbd021972948cb393e5dbd0765bf2-init/diff:/var/lib/docker/overlay2/fe05ec7db64248f1e958bdfc9b9ba43df1fa4038fd82b964b9c44dfc45743ce4/diff",
	                "MergedDir": "/var/lib/docker/overlay2/e0d5fcf77ddad13b320c07bdc8bb7444961bbd021972948cb393e5dbd0765bf2/merged",
	                "UpperDir": "/var/lib/docker/overlay2/e0d5fcf77ddad13b320c07bdc8bb7444961bbd021972948cb393e5dbd0765bf2/diff",
	                "WorkDir": "/var/lib/docker/overlay2/e0d5fcf77ddad13b320c07bdc8bb7444961bbd021972948cb393e5dbd0765bf2/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "old-k8s-version-743648",
	                "Source": "/var/lib/docker/volumes/old-k8s-version-743648/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "old-k8s-version-743648",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "old-k8s-version-743648",
	                "name.minikube.sigs.k8s.io": "old-k8s-version-743648",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "7ed0f88d2c1806020811663c2b58c0b06d233526db1777f2bc83a2bd31e3458d",
	            "SandboxKey": "/var/run/docker/netns/7ed0f88d2c18",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33066"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33067"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33070"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33068"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33069"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "old-k8s-version-743648": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.76.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "02:42:c0:a8:4c:02",
	                    "DriverOpts": null,
	                    "NetworkID": "a10a776bab45ddce4d7b589e01809f782f032b39f7671285087dd9f02ccddd4a",
	                    "EndpointID": "07fb6f0765ba07a0b700671f69ae25049b2fb1416ba68ff0ad9be22bf4de0a84",
	                    "Gateway": "192.168.76.1",
	                    "IPAddress": "192.168.76.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "old-k8s-version-743648",
	                        "4c5718840b60"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-743648 -n old-k8s-version-743648
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p old-k8s-version-743648 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-743648 logs -n 25: (2.406718184s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs: 
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| Command |                          Args                          |          Profile          |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| ssh     | -p cilium-222958 sudo find                             | cilium-222958             | jenkins | v1.34.0 | 28 Oct 24 17:46 UTC |                     |
	|         | /etc/crio -type f -exec sh -c                          |                           |         |         |                     |                     |
	|         | 'echo {}; cat {}' \;                                   |                           |         |         |                     |                     |
	| ssh     | -p cilium-222958 sudo crio                             | cilium-222958             | jenkins | v1.34.0 | 28 Oct 24 17:46 UTC |                     |
	|         | config                                                 |                           |         |         |                     |                     |
	| delete  | -p cilium-222958                                       | cilium-222958             | jenkins | v1.34.0 | 28 Oct 24 17:46 UTC | 28 Oct 24 17:46 UTC |
	| start   | -p force-systemd-env-151163                            | force-systemd-env-151163  | jenkins | v1.34.0 | 28 Oct 24 17:46 UTC | 28 Oct 24 17:46 UTC |
	|         | --memory=2048                                          |                           |         |         |                     |                     |
	|         | --alsologtostderr                                      |                           |         |         |                     |                     |
	|         | -v=5 --driver=docker                                   |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	| ssh     | force-systemd-flag-884615                              | force-systemd-flag-884615 | jenkins | v1.34.0 | 28 Oct 24 17:46 UTC | 28 Oct 24 17:46 UTC |
	|         | ssh cat                                                |                           |         |         |                     |                     |
	|         | /etc/containerd/config.toml                            |                           |         |         |                     |                     |
	| delete  | -p force-systemd-flag-884615                           | force-systemd-flag-884615 | jenkins | v1.34.0 | 28 Oct 24 17:46 UTC | 28 Oct 24 17:46 UTC |
	| start   | -p cert-expiration-568092                              | cert-expiration-568092    | jenkins | v1.34.0 | 28 Oct 24 17:46 UTC | 28 Oct 24 17:47 UTC |
	|         | --memory=2048                                          |                           |         |         |                     |                     |
	|         | --cert-expiration=3m                                   |                           |         |         |                     |                     |
	|         | --driver=docker                                        |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	| ssh     | force-systemd-env-151163                               | force-systemd-env-151163  | jenkins | v1.34.0 | 28 Oct 24 17:46 UTC | 28 Oct 24 17:46 UTC |
	|         | ssh cat                                                |                           |         |         |                     |                     |
	|         | /etc/containerd/config.toml                            |                           |         |         |                     |                     |
	| delete  | -p force-systemd-env-151163                            | force-systemd-env-151163  | jenkins | v1.34.0 | 28 Oct 24 17:46 UTC | 28 Oct 24 17:46 UTC |
	| start   | -p cert-options-636992                                 | cert-options-636992       | jenkins | v1.34.0 | 28 Oct 24 17:46 UTC | 28 Oct 24 17:47 UTC |
	|         | --memory=2048                                          |                           |         |         |                     |                     |
	|         | --apiserver-ips=127.0.0.1                              |                           |         |         |                     |                     |
	|         | --apiserver-ips=192.168.15.15                          |                           |         |         |                     |                     |
	|         | --apiserver-names=localhost                            |                           |         |         |                     |                     |
	|         | --apiserver-names=www.google.com                       |                           |         |         |                     |                     |
	|         | --apiserver-port=8555                                  |                           |         |         |                     |                     |
	|         | --driver=docker                                        |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	| ssh     | cert-options-636992 ssh                                | cert-options-636992       | jenkins | v1.34.0 | 28 Oct 24 17:47 UTC | 28 Oct 24 17:47 UTC |
	|         | openssl x509 -text -noout -in                          |                           |         |         |                     |                     |
	|         | /var/lib/minikube/certs/apiserver.crt                  |                           |         |         |                     |                     |
	| ssh     | -p cert-options-636992 -- sudo                         | cert-options-636992       | jenkins | v1.34.0 | 28 Oct 24 17:47 UTC | 28 Oct 24 17:47 UTC |
	|         | cat /etc/kubernetes/admin.conf                         |                           |         |         |                     |                     |
	| delete  | -p cert-options-636992                                 | cert-options-636992       | jenkins | v1.34.0 | 28 Oct 24 17:47 UTC | 28 Oct 24 17:47 UTC |
	| start   | -p old-k8s-version-743648                              | old-k8s-version-743648    | jenkins | v1.34.0 | 28 Oct 24 17:47 UTC | 28 Oct 24 17:49 UTC |
	|         | --memory=2200                                          |                           |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                           |         |         |                     |                     |
	|         | --kvm-network=default                                  |                           |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                          |                           |         |         |                     |                     |
	|         | --disable-driver-mounts                                |                           |         |         |                     |                     |
	|         | --keep-context=false                                   |                           |         |         |                     |                     |
	|         | --driver=docker                                        |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                           |                           |         |         |                     |                     |
	| start   | -p cert-expiration-568092                              | cert-expiration-568092    | jenkins | v1.34.0 | 28 Oct 24 17:50 UTC | 28 Oct 24 17:50 UTC |
	|         | --memory=2048                                          |                           |         |         |                     |                     |
	|         | --cert-expiration=8760h                                |                           |         |         |                     |                     |
	|         | --driver=docker                                        |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	| addons  | enable metrics-server -p old-k8s-version-743648        | old-k8s-version-743648    | jenkins | v1.34.0 | 28 Oct 24 17:50 UTC | 28 Oct 24 17:50 UTC |
	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                           |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                 |                           |         |         |                     |                     |
	| stop    | -p old-k8s-version-743648                              | old-k8s-version-743648    | jenkins | v1.34.0 | 28 Oct 24 17:50 UTC | 28 Oct 24 17:50 UTC |
	|         | --alsologtostderr -v=3                                 |                           |         |         |                     |                     |
	| delete  | -p cert-expiration-568092                              | cert-expiration-568092    | jenkins | v1.34.0 | 28 Oct 24 17:50 UTC | 28 Oct 24 17:50 UTC |
	| start   | -p no-preload-671620                                   | no-preload-671620         | jenkins | v1.34.0 | 28 Oct 24 17:50 UTC | 28 Oct 24 17:51 UTC |
	|         | --memory=2200                                          |                           |         |         |                     |                     |
	|         | --alsologtostderr                                      |                           |         |         |                     |                     |
	|         | --wait=true --preload=false                            |                           |         |         |                     |                     |
	|         | --driver=docker                                        |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.2                           |                           |         |         |                     |                     |
	| addons  | enable dashboard -p old-k8s-version-743648             | old-k8s-version-743648    | jenkins | v1.34.0 | 28 Oct 24 17:50 UTC | 28 Oct 24 17:50 UTC |
	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                           |         |         |                     |                     |
	| start   | -p old-k8s-version-743648                              | old-k8s-version-743648    | jenkins | v1.34.0 | 28 Oct 24 17:50 UTC |                     |
	|         | --memory=2200                                          |                           |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                           |         |         |                     |                     |
	|         | --kvm-network=default                                  |                           |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                          |                           |         |         |                     |                     |
	|         | --disable-driver-mounts                                |                           |         |         |                     |                     |
	|         | --keep-context=false                                   |                           |         |         |                     |                     |
	|         | --driver=docker                                        |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                           |                           |         |         |                     |                     |
	| addons  | enable metrics-server -p no-preload-671620             | no-preload-671620         | jenkins | v1.34.0 | 28 Oct 24 17:51 UTC | 28 Oct 24 17:51 UTC |
	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                           |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                 |                           |         |         |                     |                     |
	| stop    | -p no-preload-671620                                   | no-preload-671620         | jenkins | v1.34.0 | 28 Oct 24 17:51 UTC | 28 Oct 24 17:51 UTC |
	|         | --alsologtostderr -v=3                                 |                           |         |         |                     |                     |
	| addons  | enable dashboard -p no-preload-671620                  | no-preload-671620         | jenkins | v1.34.0 | 28 Oct 24 17:51 UTC | 28 Oct 24 17:51 UTC |
	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                           |         |         |                     |                     |
	| start   | -p no-preload-671620                                   | no-preload-671620         | jenkins | v1.34.0 | 28 Oct 24 17:51 UTC | 28 Oct 24 17:56 UTC |
	|         | --memory=2200                                          |                           |         |         |                     |                     |
	|         | --alsologtostderr                                      |                           |         |         |                     |                     |
	|         | --wait=true --preload=false                            |                           |         |         |                     |                     |
	|         | --driver=docker                                        |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.2                           |                           |         |         |                     |                     |
	|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/10/28 17:51:57
	Running on machine: ip-172-31-24-2
	Binary: Built with gc go1.23.2 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1028 17:51:57.292188  221317 out.go:345] Setting OutFile to fd 1 ...
	I1028 17:51:57.292745  221317 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:51:57.292800  221317 out.go:358] Setting ErrFile to fd 2...
	I1028 17:51:57.292820  221317 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:51:57.293381  221317 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
	I1028 17:51:57.293944  221317 out.go:352] Setting JSON to false
	I1028 17:51:57.295021  221317 start.go:129] hostinfo: {"hostname":"ip-172-31-24-2","uptime":5664,"bootTime":1730132254,"procs":237,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"6d436adf-771e-4269-b9a3-c25fd4fca4f5"}
	I1028 17:51:57.295174  221317 start.go:139] virtualization:  
	I1028 17:51:57.298076  221317 out.go:177] * [no-preload-671620] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	I1028 17:51:57.299700  221317 out.go:177]   - MINIKUBE_LOCATION=19872
	I1028 17:51:57.299787  221317 notify.go:220] Checking for updates...
	I1028 17:51:57.304084  221317 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 17:51:57.306177  221317 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig
	I1028 17:51:57.308558  221317 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube
	I1028 17:51:57.310536  221317 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I1028 17:51:57.312734  221317 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 17:51:57.315489  221317 config.go:182] Loaded profile config "no-preload-671620": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
	I1028 17:51:57.316078  221317 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 17:51:57.345443  221317 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
	I1028 17:51:57.345580  221317 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1028 17:51:57.401764  221317 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:40 OomKillDisable:true NGoroutines:52 SystemTime:2024-10-28 17:51:57.391582801 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I1028 17:51:57.401881  221317 docker.go:318] overlay module found
	I1028 17:51:57.404451  221317 out.go:177] * Using the docker driver based on existing profile
	I1028 17:51:57.406148  221317 start.go:297] selected driver: docker
	I1028 17:51:57.406173  221317 start.go:901] validating driver "docker" against &{Name:no-preload-671620 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:no-preload-671620 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false Mount
String:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 17:51:57.406287  221317 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 17:51:57.406992  221317 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1028 17:51:57.486992  221317 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:40 OomKillDisable:true NGoroutines:52 SystemTime:2024-10-28 17:51:57.477593611 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I1028 17:51:57.487376  221317 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 17:51:57.487413  221317 cni.go:84] Creating CNI manager for ""
	I1028 17:51:57.487456  221317 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I1028 17:51:57.487515  221317 start.go:340] cluster config:
	{Name:no-preload-671620 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:no-preload-671620 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 17:51:57.489923  221317 out.go:177] * Starting "no-preload-671620" primary control-plane node in "no-preload-671620" cluster
	I1028 17:51:57.491875  221317 cache.go:121] Beginning downloading kic base image for docker with containerd
	I1028 17:51:57.493785  221317 out.go:177] * Pulling base image v0.0.45-1730110049-19872 ...
	I1028 17:51:57.495637  221317 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime containerd
	I1028 17:51:57.495781  221317 profile.go:143] Saving config to /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/config.json ...
	I1028 17:51:57.496092  221317 cache.go:107] acquiring lock: {Name:mkc1889e206eda6e224891ce75a90606db80ad48 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 17:51:57.496174  221317 cache.go:115] /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I1028 17:51:57.496187  221317 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5" took 101.077µs
	I1028 17:51:57.496196  221317 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I1028 17:51:57.496207  221317 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 in local docker daemon
	I1028 17:51:57.496398  221317 cache.go:107] acquiring lock: {Name:mkbe39f94ce47fc6924fd6d7d9b0caa5dc6ce303 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 17:51:57.496450  221317 cache.go:115] /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.2 exists
	I1028 17:51:57.496461  221317 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.31.2" -> "/home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.2" took 69.234µs
	I1028 17:51:57.496469  221317 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.31.2 -> /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.31.2 succeeded
	I1028 17:51:57.496517  221317 cache.go:107] acquiring lock: {Name:mk6e6f6f3941301e6a5f9fd93170bdc07d431f2f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 17:51:57.496654  221317 cache.go:115] /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.2 exists
	I1028 17:51:57.496669  221317 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.31.2" -> "/home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.2" took 153.713µs
	I1028 17:51:57.496676  221317 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.31.2 -> /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.31.2 succeeded
	I1028 17:51:57.496700  221317 cache.go:107] acquiring lock: {Name:mk354793a5b27fa4a1f0232522aa406c714d7993 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 17:51:57.496736  221317 cache.go:115] /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.2 exists
	I1028 17:51:57.496747  221317 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.31.2" -> "/home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.2" took 61.398µs
	I1028 17:51:57.496754  221317 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.31.2 -> /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.31.2 succeeded
	I1028 17:51:57.496763  221317 cache.go:107] acquiring lock: {Name:mkfc0570b8e448c2f7b92efb40bbcd9d00afd8f6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 17:51:57.496794  221317 cache.go:115] /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.2 exists
	I1028 17:51:57.496803  221317 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.31.2" -> "/home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.2" took 40.878µs
	I1028 17:51:57.496809  221317 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.31.2 -> /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.31.2 succeeded
	I1028 17:51:57.496820  221317 cache.go:107] acquiring lock: {Name:mk9b4ce2c5865c4802c4745e438ea7793c4977d0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 17:51:57.496851  221317 cache.go:115] /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 exists
	I1028 17:51:57.496860  221317 cache.go:96] cache image "registry.k8s.io/etcd:3.5.15-0" -> "/home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0" took 41.198µs
	I1028 17:51:57.496866  221317 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.15-0 -> /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.5.15-0 succeeded
	I1028 17:51:57.496875  221317 cache.go:107] acquiring lock: {Name:mk8b06fb95df9c3f6a6c852d7dd9f7f27ea08a2d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 17:51:57.496905  221317 cache.go:115] /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 exists
	I1028 17:51:57.496913  221317 cache.go:96] cache image "registry.k8s.io/pause:3.10" -> "/home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10" took 39.015µs
	I1028 17:51:57.496919  221317 cache.go:80] save to tar file registry.k8s.io/pause:3.10 -> /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/pause_3.10 succeeded
	I1028 17:51:57.496938  221317 cache.go:107] acquiring lock: {Name:mk7b353df65769eceb1e3bab1d5659a44412a457 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 17:51:57.496970  221317 cache.go:115] /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3 exists
	I1028 17:51:57.496979  221317 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.3" -> "/home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3" took 42.633µs
	I1028 17:51:57.496985  221317 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.3 -> /home/jenkins/minikube-integration/19872-2421/.minikube/cache/images/arm64/registry.k8s.io/coredns/coredns_v1.11.3 succeeded
	I1028 17:51:57.496992  221317 cache.go:87] Successfully saved all images to host disk.
	I1028 17:51:57.518636  221317 image.go:98] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 in local docker daemon, skipping pull
	I1028 17:51:57.518688  221317 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 exists in daemon, skipping load
	I1028 17:51:57.518707  221317 cache.go:194] Successfully downloaded all kic artifacts
	I1028 17:51:57.518735  221317 start.go:360] acquireMachinesLock for no-preload-671620: {Name:mkfee9526470ae7fcc7fe29e972c85b9ebc7ffd4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I1028 17:51:57.518794  221317 start.go:364] duration metric: took 41.485µs to acquireMachinesLock for "no-preload-671620"
	I1028 17:51:57.518820  221317 start.go:96] Skipping create...Using existing machine configuration
	I1028 17:51:57.518828  221317 fix.go:54] fixHost starting: 
	I1028 17:51:57.519092  221317 cli_runner.go:164] Run: docker container inspect no-preload-671620 --format={{.State.Status}}
	I1028 17:51:57.535107  221317 fix.go:112] recreateIfNeeded on no-preload-671620: state=Stopped err=<nil>
	W1028 17:51:57.535147  221317 fix.go:138] unexpected machine state, will restart: <nil>
	I1028 17:51:57.537650  221317 out.go:177] * Restarting existing docker container for "no-preload-671620" ...
	I1028 17:51:56.371855  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:58.372925  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:51:57.539622  221317 cli_runner.go:164] Run: docker start no-preload-671620
	I1028 17:51:57.856034  221317 cli_runner.go:164] Run: docker container inspect no-preload-671620 --format={{.State.Status}}
	I1028 17:51:57.889475  221317 kic.go:430] container "no-preload-671620" state is running.
	I1028 17:51:57.889895  221317 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-671620
	I1028 17:51:57.916635  221317 profile.go:143] Saving config to /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/config.json ...
	I1028 17:51:57.916865  221317 machine.go:93] provisionDockerMachine start ...
	I1028 17:51:57.916940  221317 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-671620
	I1028 17:51:57.947536  221317 main.go:141] libmachine: Using SSH client type: native
	I1028 17:51:57.947813  221317 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x415580] 0x417dc0 <nil>  [] 0s} 127.0.0.1 33071 <nil> <nil>}
	I1028 17:51:57.947835  221317 main.go:141] libmachine: About to run SSH command:
	hostname
	I1028 17:51:57.948601  221317 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I1028 17:52:01.095920  221317 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-671620
	
	I1028 17:52:01.095946  221317 ubuntu.go:169] provisioning hostname "no-preload-671620"
	I1028 17:52:01.096010  221317 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-671620
	I1028 17:52:01.113921  221317 main.go:141] libmachine: Using SSH client type: native
	I1028 17:52:01.114182  221317 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x415580] 0x417dc0 <nil>  [] 0s} 127.0.0.1 33071 <nil> <nil>}
	I1028 17:52:01.114201  221317 main.go:141] libmachine: About to run SSH command:
	sudo hostname no-preload-671620 && echo "no-preload-671620" | sudo tee /etc/hostname
	I1028 17:52:01.279696  221317 main.go:141] libmachine: SSH cmd err, output: <nil>: no-preload-671620
	
	I1028 17:52:01.279848  221317 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-671620
	I1028 17:52:01.299229  221317 main.go:141] libmachine: Using SSH client type: native
	I1028 17:52:01.299502  221317 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x415580] 0x417dc0 <nil>  [] 0s} 127.0.0.1 33071 <nil> <nil>}
	I1028 17:52:01.299525  221317 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sno-preload-671620' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 no-preload-671620/g' /etc/hosts;
				else 
					echo '127.0.1.1 no-preload-671620' | sudo tee -a /etc/hosts; 
				fi
			fi
	I1028 17:52:01.453030  221317 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I1028 17:52:01.453061  221317 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19872-2421/.minikube CaCertPath:/home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19872-2421/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19872-2421/.minikube}
	I1028 17:52:01.453093  221317 ubuntu.go:177] setting up certificates
	I1028 17:52:01.453109  221317 provision.go:84] configureAuth start
	I1028 17:52:01.453171  221317 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-671620
	I1028 17:52:01.470990  221317 provision.go:143] copyHostCerts
	I1028 17:52:01.471066  221317 exec_runner.go:144] found /home/jenkins/minikube-integration/19872-2421/.minikube/ca.pem, removing ...
	I1028 17:52:01.471076  221317 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19872-2421/.minikube/ca.pem
	I1028 17:52:01.471155  221317 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19872-2421/.minikube/ca.pem (1082 bytes)
	I1028 17:52:01.471245  221317 exec_runner.go:144] found /home/jenkins/minikube-integration/19872-2421/.minikube/cert.pem, removing ...
	I1028 17:52:01.471254  221317 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19872-2421/.minikube/cert.pem
	I1028 17:52:01.471279  221317 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19872-2421/.minikube/cert.pem (1123 bytes)
	I1028 17:52:01.471327  221317 exec_runner.go:144] found /home/jenkins/minikube-integration/19872-2421/.minikube/key.pem, removing ...
	I1028 17:52:01.471339  221317 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19872-2421/.minikube/key.pem
	I1028 17:52:01.471363  221317 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19872-2421/.minikube/key.pem (1679 bytes)
	I1028 17:52:01.471415  221317 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19872-2421/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca-key.pem org=jenkins.no-preload-671620 san=[127.0.0.1 192.168.85.2 localhost minikube no-preload-671620]
	I1028 17:52:01.677376  221317 provision.go:177] copyRemoteCerts
	I1028 17:52:01.677454  221317 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I1028 17:52:01.677500  221317 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-671620
	I1028 17:52:01.696059  221317 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33071 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/no-preload-671620/id_rsa Username:docker}
	I1028 17:52:01.797573  221317 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I1028 17:52:01.824699  221317 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
	I1028 17:52:01.851432  221317 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I1028 17:52:01.879454  221317 provision.go:87] duration metric: took 426.329918ms to configureAuth
	I1028 17:52:01.879490  221317 ubuntu.go:193] setting minikube options for container-runtime
	I1028 17:52:01.879692  221317 config.go:182] Loaded profile config "no-preload-671620": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
	I1028 17:52:01.879703  221317 machine.go:96] duration metric: took 3.962830587s to provisionDockerMachine
	I1028 17:52:01.879711  221317 start.go:293] postStartSetup for "no-preload-671620" (driver="docker")
	I1028 17:52:01.879733  221317 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I1028 17:52:01.879802  221317 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I1028 17:52:01.879845  221317 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-671620
	I1028 17:52:01.898694  221317 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33071 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/no-preload-671620/id_rsa Username:docker}
	I1028 17:52:02.005956  221317 ssh_runner.go:195] Run: cat /etc/os-release
	I1028 17:52:02.010611  221317 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I1028 17:52:02.010701  221317 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I1028 17:52:02.010728  221317 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I1028 17:52:02.010751  221317 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I1028 17:52:02.010778  221317 filesync.go:126] Scanning /home/jenkins/minikube-integration/19872-2421/.minikube/addons for local assets ...
	I1028 17:52:02.010873  221317 filesync.go:126] Scanning /home/jenkins/minikube-integration/19872-2421/.minikube/files for local assets ...
	I1028 17:52:02.010999  221317 filesync.go:149] local asset: /home/jenkins/minikube-integration/19872-2421/.minikube/files/etc/ssl/certs/78662.pem -> 78662.pem in /etc/ssl/certs
	I1028 17:52:02.011151  221317 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I1028 17:52:02.022409  221317 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/files/etc/ssl/certs/78662.pem --> /etc/ssl/certs/78662.pem (1708 bytes)
	I1028 17:52:02.047969  221317 start.go:296] duration metric: took 168.231295ms for postStartSetup
	I1028 17:52:02.048118  221317 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I1028 17:52:02.048188  221317 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-671620
	I1028 17:52:02.065317  221317 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33071 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/no-preload-671620/id_rsa Username:docker}
	I1028 17:52:02.165877  221317 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I1028 17:52:02.170608  221317 fix.go:56] duration metric: took 4.651771921s for fixHost
	I1028 17:52:02.170635  221317 start.go:83] releasing machines lock for "no-preload-671620", held for 4.651826952s
	I1028 17:52:02.170714  221317 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" no-preload-671620
	I1028 17:52:02.187524  221317 ssh_runner.go:195] Run: cat /version.json
	I1028 17:52:02.187583  221317 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-671620
	I1028 17:52:02.187640  221317 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I1028 17:52:02.187701  221317 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-671620
	I1028 17:52:02.205313  221317 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33071 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/no-preload-671620/id_rsa Username:docker}
	I1028 17:52:02.213830  221317 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33071 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/no-preload-671620/id_rsa Username:docker}
	I1028 17:52:02.457328  221317 ssh_runner.go:195] Run: systemctl --version
	I1028 17:52:02.461774  221317 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I1028 17:52:02.466406  221317 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I1028 17:52:02.484656  221317 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I1028 17:52:02.484737  221317 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I1028 17:52:02.493611  221317 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I1028 17:52:02.493633  221317 start.go:495] detecting cgroup driver to use...
	I1028 17:52:02.493688  221317 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I1028 17:52:02.493736  221317 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I1028 17:52:02.507731  221317 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I1028 17:52:02.521558  221317 docker.go:217] disabling cri-docker service (if available) ...
	I1028 17:52:02.521661  221317 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I1028 17:52:02.535426  221317 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I1028 17:52:02.547195  221317 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I1028 17:52:02.627549  221317 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I1028 17:52:02.713801  221317 docker.go:233] disabling docker service ...
	I1028 17:52:02.713903  221317 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I1028 17:52:02.726926  221317 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I1028 17:52:02.739468  221317 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I1028 17:52:02.833179  221317 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I1028 17:52:02.924238  221317 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I1028 17:52:02.936096  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I1028 17:52:02.952329  221317 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
	I1028 17:52:02.962421  221317 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I1028 17:52:02.972677  221317 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I1028 17:52:02.972797  221317 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I1028 17:52:02.983207  221317 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1028 17:52:02.992928  221317 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I1028 17:52:03.002587  221317 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I1028 17:52:03.015288  221317 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I1028 17:52:03.027515  221317 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I1028 17:52:03.039017  221317 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
	I1028 17:52:03.049915  221317 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"
	I1028 17:52:03.060743  221317 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I1028 17:52:03.070733  221317 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I1028 17:52:03.079681  221317 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 17:52:03.169183  221317 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I1028 17:52:03.339197  221317 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
	I1028 17:52:03.339270  221317 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I1028 17:52:03.343799  221317 start.go:563] Will wait 60s for crictl version
	I1028 17:52:03.343869  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:52:03.347381  221317 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I1028 17:52:03.390115  221317 start.go:579] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.7.22
	RuntimeApiVersion:  v1
	I1028 17:52:03.390186  221317 ssh_runner.go:195] Run: containerd --version
	I1028 17:52:03.415580  221317 ssh_runner.go:195] Run: containerd --version
	I1028 17:52:03.445210  221317 out.go:177] * Preparing Kubernetes v1.31.2 on containerd 1.7.22 ...
	I1028 17:52:03.447658  221317 cli_runner.go:164] Run: docker network inspect no-preload-671620 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I1028 17:52:03.463754  221317 ssh_runner.go:195] Run: grep 192.168.85.1	host.minikube.internal$ /etc/hosts
	I1028 17:52:03.467765  221317 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1028 17:52:03.479190  221317 kubeadm.go:883] updating cluster {Name:no-preload-671620 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:no-preload-671620 Namespace:default APIServerHAVIP: APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenk
ins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I1028 17:52:03.479319  221317 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime containerd
	I1028 17:52:03.479368  221317 ssh_runner.go:195] Run: sudo crictl images --output json
	I1028 17:52:03.518115  221317 containerd.go:627] all images are preloaded for containerd runtime.
	I1028 17:52:03.518141  221317 cache_images.go:84] Images are preloaded, skipping loading
	I1028 17:52:03.518149  221317 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.31.2 containerd true true} ...
	I1028 17:52:03.518267  221317 kubeadm.go:946] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.31.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=no-preload-671620 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.31.2 ClusterName:no-preload-671620 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I1028 17:52:03.518333  221317 ssh_runner.go:195] Run: sudo crictl info
	I1028 17:52:03.562207  221317 cni.go:84] Creating CNI manager for ""
	I1028 17:52:03.562228  221317 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I1028 17:52:03.562239  221317 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I1028 17:52:03.562264  221317 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.31.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-671620 NodeName:no-preload-671620 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodP
ath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I1028 17:52:03.562381  221317 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.85.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///run/containerd/containerd.sock
	  name: "no-preload-671620"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.85.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      - name: "proxy-refresh-interval"
	        value: "70000"
	kubernetesVersion: v1.31.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I1028 17:52:03.562449  221317 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.2
	I1028 17:52:03.572641  221317 binaries.go:44] Found k8s binaries, skipping transfer
	I1028 17:52:03.572713  221317 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I1028 17:52:03.581989  221317 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (321 bytes)
	I1028 17:52:03.599996  221317 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I1028 17:52:03.619546  221317 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2307 bytes)
	I1028 17:52:03.638148  221317 ssh_runner.go:195] Run: grep 192.168.85.2	control-plane.minikube.internal$ /etc/hosts
	I1028 17:52:03.641781  221317 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I1028 17:52:03.652892  221317 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 17:52:03.734321  221317 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I1028 17:52:03.750334  221317 certs.go:68] Setting up /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620 for IP: 192.168.85.2
	I1028 17:52:03.750358  221317 certs.go:194] generating shared ca certs ...
	I1028 17:52:03.750375  221317 certs.go:226] acquiring lock for ca certs: {Name:mk3457f8c75e004d4fb7865e732d1b8d6b3cdec9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 17:52:03.750587  221317 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19872-2421/.minikube/ca.key
	I1028 17:52:03.750653  221317 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19872-2421/.minikube/proxy-client-ca.key
	I1028 17:52:03.750666  221317 certs.go:256] generating profile certs ...
	I1028 17:52:03.750781  221317 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.key
	I1028 17:52:03.750878  221317 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/apiserver.key.6e1bbb6c
	I1028 17:52:03.750957  221317 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/proxy-client.key
	I1028 17:52:03.751116  221317 certs.go:484] found cert: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/7866.pem (1338 bytes)
	W1028 17:52:03.751167  221317 certs.go:480] ignoring /home/jenkins/minikube-integration/19872-2421/.minikube/certs/7866_empty.pem, impossibly tiny 0 bytes
	I1028 17:52:03.751187  221317 certs.go:484] found cert: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca-key.pem (1679 bytes)
	I1028 17:52:03.751216  221317 certs.go:484] found cert: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/ca.pem (1082 bytes)
	I1028 17:52:03.751281  221317 certs.go:484] found cert: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/cert.pem (1123 bytes)
	I1028 17:52:03.751312  221317 certs.go:484] found cert: /home/jenkins/minikube-integration/19872-2421/.minikube/certs/key.pem (1679 bytes)
	I1028 17:52:03.751391  221317 certs.go:484] found cert: /home/jenkins/minikube-integration/19872-2421/.minikube/files/etc/ssl/certs/78662.pem (1708 bytes)
	I1028 17:52:03.752080  221317 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I1028 17:52:03.783982  221317 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I1028 17:52:03.811204  221317 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I1028 17:52:03.845543  221317 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I1028 17:52:03.882710  221317 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
	I1028 17:52:03.916911  221317 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I1028 17:52:03.945122  221317 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I1028 17:52:03.977684  221317 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I1028 17:52:04.021682  221317 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/files/etc/ssl/certs/78662.pem --> /usr/share/ca-certificates/78662.pem (1708 bytes)
	I1028 17:52:04.055440  221317 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I1028 17:52:04.084011  221317 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19872-2421/.minikube/certs/7866.pem --> /usr/share/ca-certificates/7866.pem (1338 bytes)
	I1028 17:52:04.110864  221317 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I1028 17:52:04.133704  221317 ssh_runner.go:195] Run: openssl version
	I1028 17:52:04.146029  221317 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/78662.pem && ln -fs /usr/share/ca-certificates/78662.pem /etc/ssl/certs/78662.pem"
	I1028 17:52:04.156755  221317 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/78662.pem
	I1028 17:52:04.160339  221317 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 28 17:09 /usr/share/ca-certificates/78662.pem
	I1028 17:52:04.160418  221317 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/78662.pem
	I1028 17:52:04.167325  221317 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/78662.pem /etc/ssl/certs/3ec20f2e.0"
	I1028 17:52:04.176801  221317 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I1028 17:52:04.186656  221317 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I1028 17:52:04.190407  221317 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 28 17:01 /usr/share/ca-certificates/minikubeCA.pem
	I1028 17:52:04.190474  221317 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I1028 17:52:04.197775  221317 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I1028 17:52:04.208149  221317 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7866.pem && ln -fs /usr/share/ca-certificates/7866.pem /etc/ssl/certs/7866.pem"
	I1028 17:52:04.217986  221317 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7866.pem
	I1028 17:52:04.221895  221317 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 28 17:09 /usr/share/ca-certificates/7866.pem
	I1028 17:52:04.221958  221317 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7866.pem
	I1028 17:52:04.229366  221317 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/7866.pem /etc/ssl/certs/51391683.0"
	I1028 17:52:04.239107  221317 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I1028 17:52:04.242836  221317 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I1028 17:52:04.250019  221317 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I1028 17:52:04.257161  221317 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I1028 17:52:04.264170  221317 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I1028 17:52:04.271995  221317 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I1028 17:52:04.279263  221317 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I1028 17:52:04.286507  221317 kubeadm.go:392] StartCluster: {Name:no-preload-671620 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:no-preload-671620 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins
:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 17:52:04.286600  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I1028 17:52:04.286658  221317 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I1028 17:52:04.333628  221317 cri.go:89] found id: "d63def5be7d9e46a5562641c82d380a0d5abcc66ad423b6d8c251ed6a42c08f4"
	I1028 17:52:04.333653  221317 cri.go:89] found id: "efad0295ee7e1fe3c973ea4a3f7a98c72f3d0be5b3d0dee42f0c78f53b76db9f"
	I1028 17:52:04.333658  221317 cri.go:89] found id: "a4d195b29434f15222415b7d38550a89522c428c0a9774aacc5c9c02b18b207c"
	I1028 17:52:04.333680  221317 cri.go:89] found id: "9e147e3805aebde63674e97b61d042ee18d5ee2dcef84c36df4f849be35b1990"
	I1028 17:52:04.333685  221317 cri.go:89] found id: "85bfc5a4f8f33d813eb912381df4cd619f7a3fa3b368a54a796edf28aca5feae"
	I1028 17:52:04.333689  221317 cri.go:89] found id: "33189239168a6db46cf78a957ecd5c5a6393840a6cf3c9da6c554d5ed902724d"
	I1028 17:52:04.333692  221317 cri.go:89] found id: "a3e7fc24d0a6b0dfe25a29286d248f9fb8e6fa1b207e811a3b6aee7f6dc25a22"
	I1028 17:52:04.333695  221317 cri.go:89] found id: "eae4ed2392aa058002dcbd6b4727d9eda2be826e9d365b59dcbaeda29b58b634"
	I1028 17:52:04.333698  221317 cri.go:89] found id: ""
	I1028 17:52:04.333773  221317 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I1028 17:52:04.349236  221317 cri.go:116] JSON = null
	W1028 17:52:04.349303  221317 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 8
	I1028 17:52:04.349369  221317 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I1028 17:52:04.361022  221317 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I1028 17:52:04.361090  221317 kubeadm.go:593] restartPrimaryControlPlane start ...
	I1028 17:52:04.361172  221317 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I1028 17:52:04.376190  221317 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I1028 17:52:04.376895  221317 kubeconfig.go:47] verify endpoint returned: get endpoint: "no-preload-671620" does not appear in /home/jenkins/minikube-integration/19872-2421/kubeconfig
	I1028 17:52:04.377225  221317 kubeconfig.go:62] /home/jenkins/minikube-integration/19872-2421/kubeconfig needs updating (will repair): [kubeconfig missing "no-preload-671620" cluster setting kubeconfig missing "no-preload-671620" context setting]
	I1028 17:52:04.377792  221317 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19872-2421/kubeconfig: {Name:mk5d0caa294b9d2ca80eaff01c0ffe9a532db746 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 17:52:04.379987  221317 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I1028 17:52:04.400583  221317 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.85.2
	I1028 17:52:04.400658  221317 kubeadm.go:597] duration metric: took 39.549104ms to restartPrimaryControlPlane
	I1028 17:52:04.400683  221317 kubeadm.go:394] duration metric: took 114.18446ms to StartCluster
	I1028 17:52:04.400723  221317 settings.go:142] acquiring lock: {Name:mk543e20b5eb6c4236b6d62e05ff811d7fc9498d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 17:52:04.400801  221317 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19872-2421/kubeconfig
	I1028 17:52:04.401767  221317 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19872-2421/kubeconfig: {Name:mk5d0caa294b9d2ca80eaff01c0ffe9a532db746 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I1028 17:52:04.402050  221317 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I1028 17:52:04.402472  221317 config.go:182] Loaded profile config "no-preload-671620": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
	I1028 17:52:04.402493  221317 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I1028 17:52:04.402811  221317 addons.go:69] Setting storage-provisioner=true in profile "no-preload-671620"
	I1028 17:52:04.402828  221317 addons.go:234] Setting addon storage-provisioner=true in "no-preload-671620"
	W1028 17:52:04.402834  221317 addons.go:243] addon storage-provisioner should already be in state true
	I1028 17:52:04.402870  221317 host.go:66] Checking if "no-preload-671620" exists ...
	I1028 17:52:04.403357  221317 cli_runner.go:164] Run: docker container inspect no-preload-671620 --format={{.State.Status}}
	I1028 17:52:04.403584  221317 addons.go:69] Setting default-storageclass=true in profile "no-preload-671620"
	I1028 17:52:04.403626  221317 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-671620"
	I1028 17:52:04.403839  221317 addons.go:69] Setting metrics-server=true in profile "no-preload-671620"
	I1028 17:52:04.403870  221317 addons.go:234] Setting addon metrics-server=true in "no-preload-671620"
	W1028 17:52:04.403890  221317 addons.go:243] addon metrics-server should already be in state true
	I1028 17:52:04.403925  221317 host.go:66] Checking if "no-preload-671620" exists ...
	I1028 17:52:04.404343  221317 cli_runner.go:164] Run: docker container inspect no-preload-671620 --format={{.State.Status}}
	I1028 17:52:04.404580  221317 cli_runner.go:164] Run: docker container inspect no-preload-671620 --format={{.State.Status}}
	I1028 17:52:04.405032  221317 addons.go:69] Setting dashboard=true in profile "no-preload-671620"
	I1028 17:52:04.405055  221317 addons.go:234] Setting addon dashboard=true in "no-preload-671620"
	W1028 17:52:04.405062  221317 addons.go:243] addon dashboard should already be in state true
	I1028 17:52:04.405102  221317 host.go:66] Checking if "no-preload-671620" exists ...
	I1028 17:52:04.405586  221317 cli_runner.go:164] Run: docker container inspect no-preload-671620 --format={{.State.Status}}
	I1028 17:52:04.413176  221317 out.go:177] * Verifying Kubernetes components...
	I1028 17:52:04.417909  221317 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I1028 17:52:04.476222  221317 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I1028 17:52:04.478633  221317 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 17:52:04.478655  221317 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I1028 17:52:04.478750  221317 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-671620
	I1028 17:52:04.483740  221317 out.go:177]   - Using image fake.domain/registry.k8s.io/echoserver:1.4
	I1028 17:52:04.484238  221317 addons.go:234] Setting addon default-storageclass=true in "no-preload-671620"
	W1028 17:52:04.484252  221317 addons.go:243] addon default-storageclass should already be in state true
	I1028 17:52:04.484288  221317 host.go:66] Checking if "no-preload-671620" exists ...
	I1028 17:52:04.484872  221317 cli_runner.go:164] Run: docker container inspect no-preload-671620 --format={{.State.Status}}
	I1028 17:52:04.488505  221317 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I1028 17:52:04.488524  221317 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I1028 17:52:04.488729  221317 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-671620
	I1028 17:52:04.490838  221317 out.go:177]   - Using image docker.io/kubernetesui/dashboard:v2.7.0
	I1028 17:52:04.495286  221317 out.go:177]   - Using image registry.k8s.io/echoserver:1.4
	I1028 17:52:00.382717  215146 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:01.374686  215146 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"True"
	I1028 17:52:01.374713  215146 pod_ready.go:82] duration metric: took 1m1.009759232s for pod "kube-controller-manager-old-k8s-version-743648" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:01.374725  215146 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-zzhjw" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:01.380398  215146 pod_ready.go:93] pod "kube-proxy-zzhjw" in "kube-system" namespace has status "Ready":"True"
	I1028 17:52:01.380426  215146 pod_ready.go:82] duration metric: took 5.693725ms for pod "kube-proxy-zzhjw" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:01.380438  215146 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-743648" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:03.386921  215146 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:04.501657  221317 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I1028 17:52:04.501687  221317 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I1028 17:52:04.501768  221317 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-671620
	I1028 17:52:04.546839  221317 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33071 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/no-preload-671620/id_rsa Username:docker}
	I1028 17:52:04.571009  221317 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I1028 17:52:04.571029  221317 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I1028 17:52:04.571094  221317 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-671620
	I1028 17:52:04.589512  221317 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33071 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/no-preload-671620/id_rsa Username:docker}
	I1028 17:52:04.591368  221317 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33071 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/no-preload-671620/id_rsa Username:docker}
	I1028 17:52:04.601102  221317 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33071 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/no-preload-671620/id_rsa Username:docker}
	I1028 17:52:04.657471  221317 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I1028 17:52:04.740706  221317 node_ready.go:35] waiting up to 6m0s for node "no-preload-671620" to be "Ready" ...
	I1028 17:52:04.812037  221317 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I1028 17:52:04.812107  221317 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
	I1028 17:52:04.843353  221317 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I1028 17:52:04.846378  221317 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I1028 17:52:04.846450  221317 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I1028 17:52:04.870370  221317 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I1028 17:52:04.870454  221317 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I1028 17:52:04.956513  221317 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I1028 17:52:04.956652  221317 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I1028 17:52:04.969335  221317 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 17:52:05.020981  221317 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I1028 17:52:05.021065  221317 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I1028 17:52:05.103292  221317 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I1028 17:52:05.103376  221317 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I1028 17:52:05.205366  221317 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I1028 17:52:05.349719  221317 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I1028 17:52:05.349801  221317 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
	W1028 17:52:05.402655  221317 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	I1028 17:52:05.402700  221317 retry.go:31] will retry after 245.186028ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	W1028 17:52:05.402767  221317 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	I1028 17:52:05.402774  221317 retry.go:31] will retry after 185.88728ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8443/openapi/v2?timeout=32s": dial tcp [::1]:8443: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	I1028 17:52:05.446938  221317 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
	I1028 17:52:05.446961  221317 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I1028 17:52:05.502637  221317 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I1028 17:52:05.502676  221317 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I1028 17:52:05.584338  221317 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I1028 17:52:05.584359  221317 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I1028 17:52:05.589608  221317 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I1028 17:52:05.648983  221317 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I1028 17:52:05.665554  221317 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I1028 17:52:05.665627  221317 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I1028 17:52:05.821258  221317 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I1028 17:52:05.821333  221317 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I1028 17:52:05.881708  221317 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I1028 17:52:05.387165  215146 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:07.887839  215146 pod_ready.go:103] pod "kube-scheduler-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:09.396099  215146 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-743648" in "kube-system" namespace has status "Ready":"True"
	I1028 17:52:09.396169  215146 pod_ready.go:82] duration metric: took 8.015721675s for pod "kube-scheduler-old-k8s-version-743648" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:09.396196  215146 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:09.994045  221317 node_ready.go:49] node "no-preload-671620" has status "Ready":"True"
	I1028 17:52:09.994078  221317 node_ready.go:38] duration metric: took 5.25333272s for node "no-preload-671620" to be "Ready" ...
	I1028 17:52:09.994089  221317 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I1028 17:52:10.018735  221317 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-62xsk" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:10.032752  221317 pod_ready.go:93] pod "coredns-7c65d6cfc9-62xsk" in "kube-system" namespace has status "Ready":"True"
	I1028 17:52:10.032792  221317 pod_ready.go:82] duration metric: took 14.00996ms for pod "coredns-7c65d6cfc9-62xsk" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:10.032806  221317 pod_ready.go:79] waiting up to 6m0s for pod "etcd-no-preload-671620" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:10.055733  221317 pod_ready.go:93] pod "etcd-no-preload-671620" in "kube-system" namespace has status "Ready":"True"
	I1028 17:52:10.055760  221317 pod_ready.go:82] duration metric: took 22.947806ms for pod "etcd-no-preload-671620" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:10.055778  221317 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-no-preload-671620" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:10.073877  221317 pod_ready.go:93] pod "kube-apiserver-no-preload-671620" in "kube-system" namespace has status "Ready":"True"
	I1028 17:52:10.073905  221317 pod_ready.go:82] duration metric: took 18.119134ms for pod "kube-apiserver-no-preload-671620" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:10.073918  221317 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-no-preload-671620" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:10.087467  221317 pod_ready.go:93] pod "kube-controller-manager-no-preload-671620" in "kube-system" namespace has status "Ready":"True"
	I1028 17:52:10.087495  221317 pod_ready.go:82] duration metric: took 13.569113ms for pod "kube-controller-manager-no-preload-671620" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:10.087508  221317 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-2nnd8" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:10.214730  221317 pod_ready.go:93] pod "kube-proxy-2nnd8" in "kube-system" namespace has status "Ready":"True"
	I1028 17:52:10.214765  221317 pod_ready.go:82] duration metric: took 127.24982ms for pod "kube-proxy-2nnd8" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:10.214778  221317 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-no-preload-671620" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:10.598275  221317 pod_ready.go:93] pod "kube-scheduler-no-preload-671620" in "kube-system" namespace has status "Ready":"True"
	I1028 17:52:10.598307  221317 pod_ready.go:82] duration metric: took 383.521759ms for pod "kube-scheduler-no-preload-671620" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:10.598320  221317 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace to be "Ready" ...
	I1028 17:52:12.606587  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:12.763641  221317 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.558189123s)
	I1028 17:52:12.763767  221317 addons.go:475] Verifying addon metrics-server=true in "no-preload-671620"
	I1028 17:52:12.828187  221317 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.238499503s)
	I1028 17:52:12.828238  221317 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (7.179185841s)
	I1028 17:52:12.828514  221317 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (6.946729135s)
	I1028 17:52:12.831542  221317 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p no-preload-671620 addons enable metrics-server
	
	I1028 17:52:12.835449  221317 out.go:177] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
	I1028 17:52:11.403439  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:13.903256  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:12.837931  221317 addons.go:510] duration metric: took 8.435433917s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]
	I1028 17:52:15.105930  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:15.905755  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:18.402603  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:17.606087  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:19.611821  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:22.105083  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:20.409296  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:22.903578  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:24.105507  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:26.604921  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:25.403212  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:27.903456  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:29.103863  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:31.105700  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:30.402618  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:32.903183  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:33.604390  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:35.605270  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:35.402894  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:37.402921  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:39.407728  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:38.105470  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:40.105739  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:42.110389  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:41.902217  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:43.902841  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:44.603774  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:46.604782  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:46.402949  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:48.403172  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:48.605501  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:50.606074  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:50.902528  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:52.904605  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:53.105730  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:55.105836  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:57.106182  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:55.401888  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:57.404216  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:59.901848  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:52:59.604831  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:01.605205  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:01.902156  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:03.903376  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:03.605451  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:06.105655  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:06.404303  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:08.904591  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:08.106357  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:10.604089  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:11.402296  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:13.903797  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:12.604820  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:14.605114  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:16.606189  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:16.402739  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:18.903188  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:19.104274  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:21.605732  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:21.401986  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:23.402635  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:24.105279  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:26.105338  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:25.902538  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:27.902722  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:29.903115  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:28.105933  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:30.116012  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:31.903725  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:34.403587  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:32.605975  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:35.105500  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:36.403772  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:38.903738  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:37.603727  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:39.604328  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:41.605079  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:41.401810  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:43.404321  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:43.607400  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:46.103761  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:45.404851  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:47.902832  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:49.903288  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:48.105018  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:50.105305  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:52.403120  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:54.902750  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:52.604388  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:54.605083  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:56.624244  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:56.902993  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:59.403935  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:53:59.104739  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:01.105380  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:01.405887  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:03.902918  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:03.604662  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:06.105835  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:06.402740  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:08.901955  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:08.605084  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:10.605668  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:10.903113  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:13.404332  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:13.104991  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:15.105568  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:15.901937  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:17.903008  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:19.903497  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:17.604796  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:19.604845  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:21.605248  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:22.402932  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:24.903029  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:24.105665  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:26.605285  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:27.402751  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:29.408164  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:29.105269  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:31.105655  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:31.902254  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:33.902654  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:33.604818  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:35.605314  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:36.403234  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:38.902989  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:37.606076  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:40.105916  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:42.107486  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:41.403337  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:43.904604  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:44.605529  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:47.104863  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:45.911071  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:48.402130  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:49.105939  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:51.605910  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:50.402970  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:52.904597  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:54.104814  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:56.105477  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:55.402156  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:57.402401  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:59.409121  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:54:58.105576  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:00.155323  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:01.902400  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:03.902455  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:02.605190  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:05.105466  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:05.902611  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:07.903035  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:07.605015  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:10.105600  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:10.403203  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:12.902646  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:14.904525  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:12.603935  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:14.604878  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:17.105017  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:17.403120  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:19.403710  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:19.606854  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:22.104941  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:21.902564  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:24.403100  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:24.106380  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:26.605225  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:26.902735  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:28.902857  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:29.105257  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:31.106142  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:31.402331  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:33.402846  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:33.604390  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:35.604427  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:35.902772  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:37.908704  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:38.105021  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:40.105209  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:42.106886  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:40.402250  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:42.403352  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:44.902191  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:44.605371  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:46.605673  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:46.902393  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:48.902433  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:49.104438  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:51.105755  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:51.402737  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:53.903135  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:53.605525  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:56.104811  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:55.904316  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:58.403625  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:55:58.112377  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:00.179960  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:00.427009  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:02.902449  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:04.903621  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:02.604228  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:04.605206  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:07.104297  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:06.904653  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:09.402306  215146 pod_ready.go:103] pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:09.402337  215146 pod_ready.go:82] duration metric: took 4m0.00611291s for pod "metrics-server-9975d5f86-4qgm8" in "kube-system" namespace to be "Ready" ...
	E1028 17:56:09.402348  215146 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
	I1028 17:56:09.402356  215146 pod_ready.go:39] duration metric: took 5m20.571187986s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I1028 17:56:09.402371  215146 api_server.go:52] waiting for apiserver process to appear ...
	I1028 17:56:09.402405  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I1028 17:56:09.402471  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I1028 17:56:09.448538  215146 cri.go:89] found id: "be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6"
	I1028 17:56:09.448610  215146 cri.go:89] found id: "c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2"
	I1028 17:56:09.448617  215146 cri.go:89] found id: ""
	I1028 17:56:09.448624  215146 logs.go:282] 2 containers: [be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6 c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2]
	I1028 17:56:09.448679  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.453245  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.456632  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I1028 17:56:09.456702  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I1028 17:56:09.501220  215146 cri.go:89] found id: "ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80"
	I1028 17:56:09.501288  215146 cri.go:89] found id: "48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420"
	I1028 17:56:09.501299  215146 cri.go:89] found id: ""
	I1028 17:56:09.501307  215146 logs.go:282] 2 containers: [ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80 48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420]
	I1028 17:56:09.501362  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.505290  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.508437  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I1028 17:56:09.508530  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I1028 17:56:09.550712  215146 cri.go:89] found id: "0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522"
	I1028 17:56:09.550740  215146 cri.go:89] found id: "697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e"
	I1028 17:56:09.550748  215146 cri.go:89] found id: ""
	I1028 17:56:09.550756  215146 logs.go:282] 2 containers: [0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522 697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e]
	I1028 17:56:09.550814  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.554604  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.558130  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I1028 17:56:09.558217  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I1028 17:56:09.596423  215146 cri.go:89] found id: "0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca"
	I1028 17:56:09.596441  215146 cri.go:89] found id: "e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98"
	I1028 17:56:09.596446  215146 cri.go:89] found id: ""
	I1028 17:56:09.596453  215146 logs.go:282] 2 containers: [0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98]
	I1028 17:56:09.596506  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.603505  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.607560  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I1028 17:56:09.607627  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I1028 17:56:09.644117  215146 cri.go:89] found id: "251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b"
	I1028 17:56:09.644141  215146 cri.go:89] found id: "f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1"
	I1028 17:56:09.644146  215146 cri.go:89] found id: ""
	I1028 17:56:09.644153  215146 logs.go:282] 2 containers: [251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1]
	I1028 17:56:09.644207  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.647803  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.651052  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I1028 17:56:09.651119  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I1028 17:56:09.691655  215146 cri.go:89] found id: "45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6"
	I1028 17:56:09.691683  215146 cri.go:89] found id: "07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45"
	I1028 17:56:09.691687  215146 cri.go:89] found id: ""
	I1028 17:56:09.691694  215146 logs.go:282] 2 containers: [45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6 07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45]
	I1028 17:56:09.691755  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.695508  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.699134  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I1028 17:56:09.699244  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I1028 17:56:09.738913  215146 cri.go:89] found id: "281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572"
	I1028 17:56:09.738939  215146 cri.go:89] found id: "eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d"
	I1028 17:56:09.738944  215146 cri.go:89] found id: ""
	I1028 17:56:09.738951  215146 logs.go:282] 2 containers: [281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572 eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d]
	I1028 17:56:09.739019  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.742717  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.746117  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I1028 17:56:09.746199  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I1028 17:56:09.784046  215146 cri.go:89] found id: "616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245"
	I1028 17:56:09.784070  215146 cri.go:89] found id: ""
	I1028 17:56:09.784078  215146 logs.go:282] 1 containers: [616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245]
	I1028 17:56:09.784132  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.787696  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I1028 17:56:09.787759  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I1028 17:56:09.835450  215146 cri.go:89] found id: "1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220"
	I1028 17:56:09.835472  215146 cri.go:89] found id: "7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78"
	I1028 17:56:09.835477  215146 cri.go:89] found id: ""
	I1028 17:56:09.835484  215146 logs.go:282] 2 containers: [1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220 7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78]
	I1028 17:56:09.835550  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.839920  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:09.844047  215146 logs.go:123] Gathering logs for coredns [0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522] ...
	I1028 17:56:09.844069  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522"
	I1028 17:56:09.887075  215146 logs.go:123] Gathering logs for kube-proxy [251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b] ...
	I1028 17:56:09.887100  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b"
	I1028 17:56:09.930757  215146 logs.go:123] Gathering logs for kube-controller-manager [45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6] ...
	I1028 17:56:09.930786  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6"
	I1028 17:56:09.989516  215146 logs.go:123] Gathering logs for kube-controller-manager [07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45] ...
	I1028 17:56:09.989550  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45"
	I1028 17:56:09.114497  221317 pod_ready.go:103] pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace has status "Ready":"False"
	I1028 17:56:10.606234  221317 pod_ready.go:82] duration metric: took 4m0.007899071s for pod "metrics-server-6867b74b74-5xptn" in "kube-system" namespace to be "Ready" ...
	E1028 17:56:10.606260  221317 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
	I1028 17:56:10.606270  221317 pod_ready.go:39] duration metric: took 4m0.612170231s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I1028 17:56:10.606286  221317 api_server.go:52] waiting for apiserver process to appear ...
	I1028 17:56:10.606330  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I1028 17:56:10.606407  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I1028 17:56:10.666360  221317 cri.go:89] found id: "1e1e5cf861857aa712a7ab10a080e52f99bd5985ec00dc21dd9f2a9205855d15"
	I1028 17:56:10.666437  221317 cri.go:89] found id: "33189239168a6db46cf78a957ecd5c5a6393840a6cf3c9da6c554d5ed902724d"
	I1028 17:56:10.666470  221317 cri.go:89] found id: ""
	I1028 17:56:10.666491  221317 logs.go:282] 2 containers: [1e1e5cf861857aa712a7ab10a080e52f99bd5985ec00dc21dd9f2a9205855d15 33189239168a6db46cf78a957ecd5c5a6393840a6cf3c9da6c554d5ed902724d]
	I1028 17:56:10.666601  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:10.673256  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:10.678769  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I1028 17:56:10.678853  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I1028 17:56:10.759553  221317 cri.go:89] found id: "9fcea94e303185b679ba542a23301f3dc3318928d26cdded5dd3c30c9153ac0a"
	I1028 17:56:10.759572  221317 cri.go:89] found id: "eae4ed2392aa058002dcbd6b4727d9eda2be826e9d365b59dcbaeda29b58b634"
	I1028 17:56:10.759577  221317 cri.go:89] found id: ""
	I1028 17:56:10.759584  221317 logs.go:282] 2 containers: [9fcea94e303185b679ba542a23301f3dc3318928d26cdded5dd3c30c9153ac0a eae4ed2392aa058002dcbd6b4727d9eda2be826e9d365b59dcbaeda29b58b634]
	I1028 17:56:10.759638  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:10.763829  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:10.767612  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I1028 17:56:10.767685  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I1028 17:56:10.839977  221317 cri.go:89] found id: "8d408e353ef4a8817b92d8b0db58930bbcaeb14974e7659a307541824bfe848e"
	I1028 17:56:10.839996  221317 cri.go:89] found id: "d63def5be7d9e46a5562641c82d380a0d5abcc66ad423b6d8c251ed6a42c08f4"
	I1028 17:56:10.840001  221317 cri.go:89] found id: ""
	I1028 17:56:10.840008  221317 logs.go:282] 2 containers: [8d408e353ef4a8817b92d8b0db58930bbcaeb14974e7659a307541824bfe848e d63def5be7d9e46a5562641c82d380a0d5abcc66ad423b6d8c251ed6a42c08f4]
	I1028 17:56:10.840062  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:10.843760  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:10.847814  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I1028 17:56:10.847887  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I1028 17:56:10.911634  221317 cri.go:89] found id: "696d41a68acec693cbcfc9f87a485eed897d5ef2f362be96ae60da3f9c7d23b7"
	I1028 17:56:10.911655  221317 cri.go:89] found id: "85bfc5a4f8f33d813eb912381df4cd619f7a3fa3b368a54a796edf28aca5feae"
	I1028 17:56:10.911660  221317 cri.go:89] found id: ""
	I1028 17:56:10.911668  221317 logs.go:282] 2 containers: [696d41a68acec693cbcfc9f87a485eed897d5ef2f362be96ae60da3f9c7d23b7 85bfc5a4f8f33d813eb912381df4cd619f7a3fa3b368a54a796edf28aca5feae]
	I1028 17:56:10.911726  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:10.916725  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:10.920643  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I1028 17:56:10.920712  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I1028 17:56:10.978268  221317 cri.go:89] found id: "7f02a5ca6f52f299154855b60bcfafa9536ede56364f84c6e92b77d0e7a87fca"
	I1028 17:56:10.978286  221317 cri.go:89] found id: "9e147e3805aebde63674e97b61d042ee18d5ee2dcef84c36df4f849be35b1990"
	I1028 17:56:10.978291  221317 cri.go:89] found id: ""
	I1028 17:56:10.978310  221317 logs.go:282] 2 containers: [7f02a5ca6f52f299154855b60bcfafa9536ede56364f84c6e92b77d0e7a87fca 9e147e3805aebde63674e97b61d042ee18d5ee2dcef84c36df4f849be35b1990]
	I1028 17:56:10.978366  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:10.983423  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:10.987335  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I1028 17:56:10.987401  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I1028 17:56:11.062534  221317 cri.go:89] found id: "db0e6263ce4a2ff18933003f84190449d588b2ca7534114c2d0420303a9ad8e3"
	I1028 17:56:11.062554  221317 cri.go:89] found id: "a3e7fc24d0a6b0dfe25a29286d248f9fb8e6fa1b207e811a3b6aee7f6dc25a22"
	I1028 17:56:11.062559  221317 cri.go:89] found id: ""
	I1028 17:56:11.062566  221317 logs.go:282] 2 containers: [db0e6263ce4a2ff18933003f84190449d588b2ca7534114c2d0420303a9ad8e3 a3e7fc24d0a6b0dfe25a29286d248f9fb8e6fa1b207e811a3b6aee7f6dc25a22]
	I1028 17:56:11.062633  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:11.073005  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:11.079278  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I1028 17:56:11.079366  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I1028 17:56:11.155252  221317 cri.go:89] found id: "c68c99fda2518ff8fdb5438a903a07017af2d8a0eabc9b35d9108e9bacdac080"
	I1028 17:56:11.155283  221317 cri.go:89] found id: "efad0295ee7e1fe3c973ea4a3f7a98c72f3d0be5b3d0dee42f0c78f53b76db9f"
	I1028 17:56:11.155289  221317 cri.go:89] found id: ""
	I1028 17:56:11.155297  221317 logs.go:282] 2 containers: [c68c99fda2518ff8fdb5438a903a07017af2d8a0eabc9b35d9108e9bacdac080 efad0295ee7e1fe3c973ea4a3f7a98c72f3d0be5b3d0dee42f0c78f53b76db9f]
	I1028 17:56:11.155371  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:11.165343  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:11.177230  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I1028 17:56:11.177356  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I1028 17:56:11.250284  221317 cri.go:89] found id: "45d7397effb45132bfd87686b4f1a1cdc88cbeec8ab86fd7b747f45060f5f2cd"
	I1028 17:56:11.250303  221317 cri.go:89] found id: ""
	I1028 17:56:11.250311  221317 logs.go:282] 1 containers: [45d7397effb45132bfd87686b4f1a1cdc88cbeec8ab86fd7b747f45060f5f2cd]
	I1028 17:56:11.250376  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:11.254624  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I1028 17:56:11.254699  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I1028 17:56:11.313196  221317 cri.go:89] found id: "488ca23a69b452d0610ad06bc99e9395a13caf8dcfce88e7d09aae9f9de5cdf8"
	I1028 17:56:11.313217  221317 cri.go:89] found id: "f3ce6939c594611802dcee78331360a0842815b0456259a4a45448e6873e9345"
	I1028 17:56:11.313222  221317 cri.go:89] found id: ""
	I1028 17:56:11.313229  221317 logs.go:282] 2 containers: [488ca23a69b452d0610ad06bc99e9395a13caf8dcfce88e7d09aae9f9de5cdf8 f3ce6939c594611802dcee78331360a0842815b0456259a4a45448e6873e9345]
	I1028 17:56:11.313284  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:11.317578  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:11.321727  221317 logs.go:123] Gathering logs for kube-apiserver [1e1e5cf861857aa712a7ab10a080e52f99bd5985ec00dc21dd9f2a9205855d15] ...
	I1028 17:56:11.321751  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1e1e5cf861857aa712a7ab10a080e52f99bd5985ec00dc21dd9f2a9205855d15"
	I1028 17:56:11.413482  221317 logs.go:123] Gathering logs for coredns [8d408e353ef4a8817b92d8b0db58930bbcaeb14974e7659a307541824bfe848e] ...
	I1028 17:56:11.413516  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8d408e353ef4a8817b92d8b0db58930bbcaeb14974e7659a307541824bfe848e"
	I1028 17:56:11.457061  221317 logs.go:123] Gathering logs for coredns [d63def5be7d9e46a5562641c82d380a0d5abcc66ad423b6d8c251ed6a42c08f4] ...
	I1028 17:56:11.457096  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d63def5be7d9e46a5562641c82d380a0d5abcc66ad423b6d8c251ed6a42c08f4"
	I1028 17:56:11.500824  221317 logs.go:123] Gathering logs for kube-scheduler [696d41a68acec693cbcfc9f87a485eed897d5ef2f362be96ae60da3f9c7d23b7] ...
	I1028 17:56:11.500850  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 696d41a68acec693cbcfc9f87a485eed897d5ef2f362be96ae60da3f9c7d23b7"
	I1028 17:56:11.543919  221317 logs.go:123] Gathering logs for kube-scheduler [85bfc5a4f8f33d813eb912381df4cd619f7a3fa3b368a54a796edf28aca5feae] ...
	I1028 17:56:11.544000  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 85bfc5a4f8f33d813eb912381df4cd619f7a3fa3b368a54a796edf28aca5feae"
	I1028 17:56:11.594634  221317 logs.go:123] Gathering logs for kube-proxy [9e147e3805aebde63674e97b61d042ee18d5ee2dcef84c36df4f849be35b1990] ...
	I1028 17:56:11.594668  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9e147e3805aebde63674e97b61d042ee18d5ee2dcef84c36df4f849be35b1990"
	I1028 17:56:11.643652  221317 logs.go:123] Gathering logs for storage-provisioner [f3ce6939c594611802dcee78331360a0842815b0456259a4a45448e6873e9345] ...
	I1028 17:56:11.643681  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f3ce6939c594611802dcee78331360a0842815b0456259a4a45448e6873e9345"
	I1028 17:56:11.698905  221317 logs.go:123] Gathering logs for kube-apiserver [33189239168a6db46cf78a957ecd5c5a6393840a6cf3c9da6c554d5ed902724d] ...
	I1028 17:56:11.698974  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 33189239168a6db46cf78a957ecd5c5a6393840a6cf3c9da6c554d5ed902724d"
	I1028 17:56:11.768759  221317 logs.go:123] Gathering logs for kube-proxy [7f02a5ca6f52f299154855b60bcfafa9536ede56364f84c6e92b77d0e7a87fca] ...
	I1028 17:56:11.768797  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7f02a5ca6f52f299154855b60bcfafa9536ede56364f84c6e92b77d0e7a87fca"
	I1028 17:56:11.810536  221317 logs.go:123] Gathering logs for kindnet [c68c99fda2518ff8fdb5438a903a07017af2d8a0eabc9b35d9108e9bacdac080] ...
	I1028 17:56:11.810563  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c68c99fda2518ff8fdb5438a903a07017af2d8a0eabc9b35d9108e9bacdac080"
	I1028 17:56:11.863285  221317 logs.go:123] Gathering logs for etcd [9fcea94e303185b679ba542a23301f3dc3318928d26cdded5dd3c30c9153ac0a] ...
	I1028 17:56:11.863315  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9fcea94e303185b679ba542a23301f3dc3318928d26cdded5dd3c30c9153ac0a"
	I1028 17:56:11.919903  221317 logs.go:123] Gathering logs for etcd [eae4ed2392aa058002dcbd6b4727d9eda2be826e9d365b59dcbaeda29b58b634] ...
	I1028 17:56:11.919991  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 eae4ed2392aa058002dcbd6b4727d9eda2be826e9d365b59dcbaeda29b58b634"
	I1028 17:56:11.966957  221317 logs.go:123] Gathering logs for kube-controller-manager [a3e7fc24d0a6b0dfe25a29286d248f9fb8e6fa1b207e811a3b6aee7f6dc25a22] ...
	I1028 17:56:11.966988  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a3e7fc24d0a6b0dfe25a29286d248f9fb8e6fa1b207e811a3b6aee7f6dc25a22"
	I1028 17:56:12.045742  221317 logs.go:123] Gathering logs for kubernetes-dashboard [45d7397effb45132bfd87686b4f1a1cdc88cbeec8ab86fd7b747f45060f5f2cd] ...
	I1028 17:56:12.045784  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 45d7397effb45132bfd87686b4f1a1cdc88cbeec8ab86fd7b747f45060f5f2cd"
	I1028 17:56:12.091510  221317 logs.go:123] Gathering logs for containerd ...
	I1028 17:56:12.091537  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I1028 17:56:12.154140  221317 logs.go:123] Gathering logs for container status ...
	I1028 17:56:12.154176  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 17:56:12.214893  221317 logs.go:123] Gathering logs for kubelet ...
	I1028 17:56:12.214923  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 17:56:10.075876  215146 logs.go:123] Gathering logs for storage-provisioner [1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220] ...
	I1028 17:56:10.075913  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220"
	I1028 17:56:10.131752  215146 logs.go:123] Gathering logs for container status ...
	I1028 17:56:10.131782  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 17:56:10.189774  215146 logs.go:123] Gathering logs for kubelet ...
	I1028 17:56:10.189811  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W1028 17:56:10.260140  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.823989     666 reflector.go:138] object-"kube-system"/"metrics-server-token-s8546": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-s8546" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.260375  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.825360     666 reflector.go:138] object-"kube-system"/"kindnet-token-rzkm7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-rzkm7" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.260691  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.826686     666 reflector.go:138] object-"kube-system"/"coredns-token-bhrx5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-bhrx5" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.260895  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.827119     666 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.261159  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.827457     666 reflector.go:138] object-"kube-system"/"kube-proxy-token-j55lg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-j55lg" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.263578  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.862535     666 reflector.go:138] object-"kube-system"/"storage-provisioner-token-42rw4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-42rw4" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.263789  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.862690     666 reflector.go:138] object-"default"/"default-token-8g42r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-8g42r" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.265241  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.862027     666 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:10.273845  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:52 old-k8s-version-743648 kubelet[666]: E1028 17:50:52.034873     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:10.274042  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:52 old-k8s-version-743648 kubelet[666]: E1028 17:50:52.426336     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.276900  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:04 old-k8s-version-743648 kubelet[666]: E1028 17:51:04.181734     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:10.278592  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:15 old-k8s-version-743648 kubelet[666]: E1028 17:51:15.145992     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.279523  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:20 old-k8s-version-743648 kubelet[666]: E1028 17:51:20.589441     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.279852  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:21 old-k8s-version-743648 kubelet[666]: E1028 17:51:21.593639     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.280289  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:23 old-k8s-version-743648 kubelet[666]: E1028 17:51:23.609906     666 pod_workers.go:191] Error syncing pod 8ffc3abd-c784-474f-80a5-f6a8b25abc51 ("storage-provisioner_kube-system(8ffc3abd-c784-474f-80a5-f6a8b25abc51)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(8ffc3abd-c784-474f-80a5-f6a8b25abc51)"
	W1028 17:56:10.280628  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:25 old-k8s-version-743648 kubelet[666]: E1028 17:51:25.775266     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.283444  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:29 old-k8s-version-743648 kubelet[666]: E1028 17:51:29.147486     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:10.283892  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:41 old-k8s-version-743648 kubelet[666]: E1028 17:51:41.138852     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.284352  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:41 old-k8s-version-743648 kubelet[666]: E1028 17:51:41.660884     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.284688  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:45 old-k8s-version-743648 kubelet[666]: E1028 17:51:45.774632     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.284874  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:52 old-k8s-version-743648 kubelet[666]: E1028 17:51:52.138242     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.285204  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:59 old-k8s-version-743648 kubelet[666]: E1028 17:51:59.137591     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.285395  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:05 old-k8s-version-743648 kubelet[666]: E1028 17:52:05.138208     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.285982  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:14 old-k8s-version-743648 kubelet[666]: E1028 17:52:14.756224     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.286310  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:15 old-k8s-version-743648 kubelet[666]: E1028 17:52:15.774720     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.288793  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:17 old-k8s-version-743648 kubelet[666]: E1028 17:52:17.148693     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:10.289126  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:28 old-k8s-version-743648 kubelet[666]: E1028 17:52:28.141800     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.289309  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:32 old-k8s-version-743648 kubelet[666]: E1028 17:52:32.138343     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.289637  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:40 old-k8s-version-743648 kubelet[666]: E1028 17:52:40.138205     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.289820  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:44 old-k8s-version-743648 kubelet[666]: E1028 17:52:44.140775     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.290404  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:55 old-k8s-version-743648 kubelet[666]: E1028 17:52:55.867579     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.290588  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:58 old-k8s-version-743648 kubelet[666]: E1028 17:52:58.138213     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.290916  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:05 old-k8s-version-743648 kubelet[666]: E1028 17:53:05.775406     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.291101  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:13 old-k8s-version-743648 kubelet[666]: E1028 17:53:13.138098     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.291427  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:17 old-k8s-version-743648 kubelet[666]: E1028 17:53:17.137660     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.291608  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:25 old-k8s-version-743648 kubelet[666]: E1028 17:53:25.138080     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.291950  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:28 old-k8s-version-743648 kubelet[666]: E1028 17:53:28.141572     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.294378  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:39 old-k8s-version-743648 kubelet[666]: E1028 17:53:39.147007     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:10.294718  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:43 old-k8s-version-743648 kubelet[666]: E1028 17:53:43.137608     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.294904  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:52 old-k8s-version-743648 kubelet[666]: E1028 17:53:52.138963     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.295229  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:57 old-k8s-version-743648 kubelet[666]: E1028 17:53:57.137666     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.295414  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:03 old-k8s-version-743648 kubelet[666]: E1028 17:54:03.139810     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.295738  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:08 old-k8s-version-743648 kubelet[666]: E1028 17:54:08.137748     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.295926  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:15 old-k8s-version-743648 kubelet[666]: E1028 17:54:15.138210     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.296514  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:22 old-k8s-version-743648 kubelet[666]: E1028 17:54:22.110858     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.296852  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:25 old-k8s-version-743648 kubelet[666]: E1028 17:54:25.774510     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.297038  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:26 old-k8s-version-743648 kubelet[666]: E1028 17:54:26.142477     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.297362  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:36 old-k8s-version-743648 kubelet[666]: E1028 17:54:36.140263     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.297545  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:40 old-k8s-version-743648 kubelet[666]: E1028 17:54:40.138696     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.297872  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:51 old-k8s-version-743648 kubelet[666]: E1028 17:54:51.137643     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.298055  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:54 old-k8s-version-743648 kubelet[666]: E1028 17:54:54.140745     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.298386  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:05 old-k8s-version-743648 kubelet[666]: E1028 17:55:05.137675     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.298570  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:06 old-k8s-version-743648 kubelet[666]: E1028 17:55:06.141555     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.298895  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:18 old-k8s-version-743648 kubelet[666]: E1028 17:55:18.142304     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.299079  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:18 old-k8s-version-743648 kubelet[666]: E1028 17:55:18.144881     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.299262  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:30 old-k8s-version-743648 kubelet[666]: E1028 17:55:30.145457     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.299586  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:30 old-k8s-version-743648 kubelet[666]: E1028 17:55:30.148252     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.299910  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.143236     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.300093  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.149385     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:10.300421  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:56 old-k8s-version-743648 kubelet[666]: E1028 17:55:56.138548     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:10.300632  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:59 old-k8s-version-743648 kubelet[666]: E1028 17:55:59.138036     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I1028 17:56:10.300643  215146 logs.go:123] Gathering logs for describe nodes ...
	I1028 17:56:10.300657  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 17:56:10.461900  215146 logs.go:123] Gathering logs for etcd [ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80] ...
	I1028 17:56:10.461929  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80"
	I1028 17:56:10.543636  215146 logs.go:123] Gathering logs for etcd [48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420] ...
	I1028 17:56:10.543667  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420"
	I1028 17:56:10.596502  215146 logs.go:123] Gathering logs for kube-scheduler [0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca] ...
	I1028 17:56:10.596534  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca"
	I1028 17:56:10.668010  215146 logs.go:123] Gathering logs for kube-proxy [f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1] ...
	I1028 17:56:10.668084  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1"
	I1028 17:56:10.718076  215146 logs.go:123] Gathering logs for containerd ...
	I1028 17:56:10.718154  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I1028 17:56:10.799093  215146 logs.go:123] Gathering logs for dmesg ...
	I1028 17:56:10.799138  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 17:56:10.817662  215146 logs.go:123] Gathering logs for kube-apiserver [c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2] ...
	I1028 17:56:10.817695  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2"
	I1028 17:56:10.898218  215146 logs.go:123] Gathering logs for kindnet [eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d] ...
	I1028 17:56:10.898249  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d"
	I1028 17:56:10.949120  215146 logs.go:123] Gathering logs for kubernetes-dashboard [616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245] ...
	I1028 17:56:10.949162  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245"
	I1028 17:56:11.003335  215146 logs.go:123] Gathering logs for kube-apiserver [be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6] ...
	I1028 17:56:11.003364  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6"
	I1028 17:56:11.097068  215146 logs.go:123] Gathering logs for kindnet [281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572] ...
	I1028 17:56:11.097153  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572"
	I1028 17:56:11.199799  215146 logs.go:123] Gathering logs for storage-provisioner [7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78] ...
	I1028 17:56:11.199905  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78"
	I1028 17:56:11.294982  215146 logs.go:123] Gathering logs for coredns [697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e] ...
	I1028 17:56:11.295052  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e"
	I1028 17:56:11.350232  215146 logs.go:123] Gathering logs for kube-scheduler [e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98] ...
	I1028 17:56:11.350305  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98"
	I1028 17:56:11.409560  215146 out.go:358] Setting ErrFile to fd 2...
	I1028 17:56:11.409639  215146 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W1028 17:56:11.409735  215146 out.go:270] X Problems detected in kubelet:
	W1028 17:56:11.409781  215146 out.go:270]   Oct 28 17:55:30 old-k8s-version-743648 kubelet[666]: E1028 17:55:30.148252     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:11.409949  215146 out.go:270]   Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.143236     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:11.409983  215146 out.go:270]   Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.149385     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:11.410035  215146 out.go:270]   Oct 28 17:55:56 old-k8s-version-743648 kubelet[666]: E1028 17:55:56.138548     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:11.410082  215146 out.go:270]   Oct 28 17:55:59 old-k8s-version-743648 kubelet[666]: E1028 17:55:59.138036     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I1028 17:56:11.410132  215146 out.go:358] Setting ErrFile to fd 2...
	I1028 17:56:11.410153  215146 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:56:12.297195  221317 logs.go:123] Gathering logs for dmesg ...
	I1028 17:56:12.297229  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 17:56:12.313620  221317 logs.go:123] Gathering logs for describe nodes ...
	I1028 17:56:12.313648  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 17:56:12.469140  221317 logs.go:123] Gathering logs for kube-controller-manager [db0e6263ce4a2ff18933003f84190449d588b2ca7534114c2d0420303a9ad8e3] ...
	I1028 17:56:12.469180  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 db0e6263ce4a2ff18933003f84190449d588b2ca7534114c2d0420303a9ad8e3"
	I1028 17:56:12.545836  221317 logs.go:123] Gathering logs for kindnet [efad0295ee7e1fe3c973ea4a3f7a98c72f3d0be5b3d0dee42f0c78f53b76db9f] ...
	I1028 17:56:12.545879  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 efad0295ee7e1fe3c973ea4a3f7a98c72f3d0be5b3d0dee42f0c78f53b76db9f"
	I1028 17:56:12.592348  221317 logs.go:123] Gathering logs for storage-provisioner [488ca23a69b452d0610ad06bc99e9395a13caf8dcfce88e7d09aae9f9de5cdf8] ...
	I1028 17:56:12.592418  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 488ca23a69b452d0610ad06bc99e9395a13caf8dcfce88e7d09aae9f9de5cdf8"
	I1028 17:56:15.131724  221317 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 17:56:15.146711  221317 api_server.go:72] duration metric: took 4m10.744601945s to wait for apiserver process to appear ...
	I1028 17:56:15.146738  221317 api_server.go:88] waiting for apiserver healthz status ...
	I1028 17:56:15.146781  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I1028 17:56:15.146847  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I1028 17:56:15.185686  221317 cri.go:89] found id: "1e1e5cf861857aa712a7ab10a080e52f99bd5985ec00dc21dd9f2a9205855d15"
	I1028 17:56:15.185724  221317 cri.go:89] found id: "33189239168a6db46cf78a957ecd5c5a6393840a6cf3c9da6c554d5ed902724d"
	I1028 17:56:15.185735  221317 cri.go:89] found id: ""
	I1028 17:56:15.185743  221317 logs.go:282] 2 containers: [1e1e5cf861857aa712a7ab10a080e52f99bd5985ec00dc21dd9f2a9205855d15 33189239168a6db46cf78a957ecd5c5a6393840a6cf3c9da6c554d5ed902724d]
	I1028 17:56:15.185803  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.189957  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.194125  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I1028 17:56:15.194212  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I1028 17:56:15.244702  221317 cri.go:89] found id: "9fcea94e303185b679ba542a23301f3dc3318928d26cdded5dd3c30c9153ac0a"
	I1028 17:56:15.244726  221317 cri.go:89] found id: "eae4ed2392aa058002dcbd6b4727d9eda2be826e9d365b59dcbaeda29b58b634"
	I1028 17:56:15.244731  221317 cri.go:89] found id: ""
	I1028 17:56:15.244738  221317 logs.go:282] 2 containers: [9fcea94e303185b679ba542a23301f3dc3318928d26cdded5dd3c30c9153ac0a eae4ed2392aa058002dcbd6b4727d9eda2be826e9d365b59dcbaeda29b58b634]
	I1028 17:56:15.244799  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.249068  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.253570  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I1028 17:56:15.253649  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I1028 17:56:15.295353  221317 cri.go:89] found id: "8d408e353ef4a8817b92d8b0db58930bbcaeb14974e7659a307541824bfe848e"
	I1028 17:56:15.295374  221317 cri.go:89] found id: "d63def5be7d9e46a5562641c82d380a0d5abcc66ad423b6d8c251ed6a42c08f4"
	I1028 17:56:15.295379  221317 cri.go:89] found id: ""
	I1028 17:56:15.295386  221317 logs.go:282] 2 containers: [8d408e353ef4a8817b92d8b0db58930bbcaeb14974e7659a307541824bfe848e d63def5be7d9e46a5562641c82d380a0d5abcc66ad423b6d8c251ed6a42c08f4]
	I1028 17:56:15.295447  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.299222  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.302977  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I1028 17:56:15.303045  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I1028 17:56:15.348806  221317 cri.go:89] found id: "696d41a68acec693cbcfc9f87a485eed897d5ef2f362be96ae60da3f9c7d23b7"
	I1028 17:56:15.348828  221317 cri.go:89] found id: "85bfc5a4f8f33d813eb912381df4cd619f7a3fa3b368a54a796edf28aca5feae"
	I1028 17:56:15.348835  221317 cri.go:89] found id: ""
	I1028 17:56:15.348842  221317 logs.go:282] 2 containers: [696d41a68acec693cbcfc9f87a485eed897d5ef2f362be96ae60da3f9c7d23b7 85bfc5a4f8f33d813eb912381df4cd619f7a3fa3b368a54a796edf28aca5feae]
	I1028 17:56:15.348899  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.352807  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.356417  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I1028 17:56:15.356623  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I1028 17:56:15.405732  221317 cri.go:89] found id: "7f02a5ca6f52f299154855b60bcfafa9536ede56364f84c6e92b77d0e7a87fca"
	I1028 17:56:15.405756  221317 cri.go:89] found id: "9e147e3805aebde63674e97b61d042ee18d5ee2dcef84c36df4f849be35b1990"
	I1028 17:56:15.405775  221317 cri.go:89] found id: ""
	I1028 17:56:15.405801  221317 logs.go:282] 2 containers: [7f02a5ca6f52f299154855b60bcfafa9536ede56364f84c6e92b77d0e7a87fca 9e147e3805aebde63674e97b61d042ee18d5ee2dcef84c36df4f849be35b1990]
	I1028 17:56:15.405938  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.410291  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.413886  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I1028 17:56:15.413965  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I1028 17:56:15.457597  221317 cri.go:89] found id: "db0e6263ce4a2ff18933003f84190449d588b2ca7534114c2d0420303a9ad8e3"
	I1028 17:56:15.457620  221317 cri.go:89] found id: "a3e7fc24d0a6b0dfe25a29286d248f9fb8e6fa1b207e811a3b6aee7f6dc25a22"
	I1028 17:56:15.457625  221317 cri.go:89] found id: ""
	I1028 17:56:15.457633  221317 logs.go:282] 2 containers: [db0e6263ce4a2ff18933003f84190449d588b2ca7534114c2d0420303a9ad8e3 a3e7fc24d0a6b0dfe25a29286d248f9fb8e6fa1b207e811a3b6aee7f6dc25a22]
	I1028 17:56:15.457692  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.463333  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.467219  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I1028 17:56:15.467292  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I1028 17:56:15.520169  221317 cri.go:89] found id: "c68c99fda2518ff8fdb5438a903a07017af2d8a0eabc9b35d9108e9bacdac080"
	I1028 17:56:15.520235  221317 cri.go:89] found id: "efad0295ee7e1fe3c973ea4a3f7a98c72f3d0be5b3d0dee42f0c78f53b76db9f"
	I1028 17:56:15.520253  221317 cri.go:89] found id: ""
	I1028 17:56:15.520275  221317 logs.go:282] 2 containers: [c68c99fda2518ff8fdb5438a903a07017af2d8a0eabc9b35d9108e9bacdac080 efad0295ee7e1fe3c973ea4a3f7a98c72f3d0be5b3d0dee42f0c78f53b76db9f]
	I1028 17:56:15.520389  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.524199  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.534812  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I1028 17:56:15.534885  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I1028 17:56:15.573528  221317 cri.go:89] found id: "45d7397effb45132bfd87686b4f1a1cdc88cbeec8ab86fd7b747f45060f5f2cd"
	I1028 17:56:15.573551  221317 cri.go:89] found id: ""
	I1028 17:56:15.573558  221317 logs.go:282] 1 containers: [45d7397effb45132bfd87686b4f1a1cdc88cbeec8ab86fd7b747f45060f5f2cd]
	I1028 17:56:15.573620  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.577319  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I1028 17:56:15.577416  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I1028 17:56:15.613543  221317 cri.go:89] found id: "488ca23a69b452d0610ad06bc99e9395a13caf8dcfce88e7d09aae9f9de5cdf8"
	I1028 17:56:15.613565  221317 cri.go:89] found id: "f3ce6939c594611802dcee78331360a0842815b0456259a4a45448e6873e9345"
	I1028 17:56:15.613570  221317 cri.go:89] found id: ""
	I1028 17:56:15.613577  221317 logs.go:282] 2 containers: [488ca23a69b452d0610ad06bc99e9395a13caf8dcfce88e7d09aae9f9de5cdf8 f3ce6939c594611802dcee78331360a0842815b0456259a4a45448e6873e9345]
	I1028 17:56:15.613652  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.617193  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:15.620503  221317 logs.go:123] Gathering logs for kube-scheduler [85bfc5a4f8f33d813eb912381df4cd619f7a3fa3b368a54a796edf28aca5feae] ...
	I1028 17:56:15.620529  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 85bfc5a4f8f33d813eb912381df4cd619f7a3fa3b368a54a796edf28aca5feae"
	I1028 17:56:15.670160  221317 logs.go:123] Gathering logs for kube-proxy [9e147e3805aebde63674e97b61d042ee18d5ee2dcef84c36df4f849be35b1990] ...
	I1028 17:56:15.670190  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9e147e3805aebde63674e97b61d042ee18d5ee2dcef84c36df4f849be35b1990"
	I1028 17:56:15.708980  221317 logs.go:123] Gathering logs for storage-provisioner [f3ce6939c594611802dcee78331360a0842815b0456259a4a45448e6873e9345] ...
	I1028 17:56:15.709008  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f3ce6939c594611802dcee78331360a0842815b0456259a4a45448e6873e9345"
	I1028 17:56:15.748641  221317 logs.go:123] Gathering logs for dmesg ...
	I1028 17:56:15.748671  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 17:56:15.764000  221317 logs.go:123] Gathering logs for etcd [9fcea94e303185b679ba542a23301f3dc3318928d26cdded5dd3c30c9153ac0a] ...
	I1028 17:56:15.764070  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9fcea94e303185b679ba542a23301f3dc3318928d26cdded5dd3c30c9153ac0a"
	I1028 17:56:15.815288  221317 logs.go:123] Gathering logs for kubernetes-dashboard [45d7397effb45132bfd87686b4f1a1cdc88cbeec8ab86fd7b747f45060f5f2cd] ...
	I1028 17:56:15.815322  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 45d7397effb45132bfd87686b4f1a1cdc88cbeec8ab86fd7b747f45060f5f2cd"
	I1028 17:56:15.858741  221317 logs.go:123] Gathering logs for storage-provisioner [488ca23a69b452d0610ad06bc99e9395a13caf8dcfce88e7d09aae9f9de5cdf8] ...
	I1028 17:56:15.858775  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 488ca23a69b452d0610ad06bc99e9395a13caf8dcfce88e7d09aae9f9de5cdf8"
	I1028 17:56:15.899614  221317 logs.go:123] Gathering logs for containerd ...
	I1028 17:56:15.899640  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I1028 17:56:15.965707  221317 logs.go:123] Gathering logs for kubelet ...
	I1028 17:56:15.965744  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 17:56:16.041682  221317 logs.go:123] Gathering logs for kube-apiserver [1e1e5cf861857aa712a7ab10a080e52f99bd5985ec00dc21dd9f2a9205855d15] ...
	I1028 17:56:16.041719  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1e1e5cf861857aa712a7ab10a080e52f99bd5985ec00dc21dd9f2a9205855d15"
	I1028 17:56:16.098536  221317 logs.go:123] Gathering logs for kube-controller-manager [db0e6263ce4a2ff18933003f84190449d588b2ca7534114c2d0420303a9ad8e3] ...
	I1028 17:56:16.098581  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 db0e6263ce4a2ff18933003f84190449d588b2ca7534114c2d0420303a9ad8e3"
	I1028 17:56:16.179851  221317 logs.go:123] Gathering logs for kube-controller-manager [a3e7fc24d0a6b0dfe25a29286d248f9fb8e6fa1b207e811a3b6aee7f6dc25a22] ...
	I1028 17:56:16.179883  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a3e7fc24d0a6b0dfe25a29286d248f9fb8e6fa1b207e811a3b6aee7f6dc25a22"
	I1028 17:56:16.241253  221317 logs.go:123] Gathering logs for kindnet [efad0295ee7e1fe3c973ea4a3f7a98c72f3d0be5b3d0dee42f0c78f53b76db9f] ...
	I1028 17:56:16.241287  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 efad0295ee7e1fe3c973ea4a3f7a98c72f3d0be5b3d0dee42f0c78f53b76db9f"
	I1028 17:56:16.279438  221317 logs.go:123] Gathering logs for container status ...
	I1028 17:56:16.279474  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 17:56:16.323402  221317 logs.go:123] Gathering logs for describe nodes ...
	I1028 17:56:16.323573  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 17:56:16.454817  221317 logs.go:123] Gathering logs for etcd [eae4ed2392aa058002dcbd6b4727d9eda2be826e9d365b59dcbaeda29b58b634] ...
	I1028 17:56:16.454849  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 eae4ed2392aa058002dcbd6b4727d9eda2be826e9d365b59dcbaeda29b58b634"
	I1028 17:56:16.507195  221317 logs.go:123] Gathering logs for coredns [d63def5be7d9e46a5562641c82d380a0d5abcc66ad423b6d8c251ed6a42c08f4] ...
	I1028 17:56:16.507227  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d63def5be7d9e46a5562641c82d380a0d5abcc66ad423b6d8c251ed6a42c08f4"
	I1028 17:56:16.549629  221317 logs.go:123] Gathering logs for kube-scheduler [696d41a68acec693cbcfc9f87a485eed897d5ef2f362be96ae60da3f9c7d23b7] ...
	I1028 17:56:16.549658  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 696d41a68acec693cbcfc9f87a485eed897d5ef2f362be96ae60da3f9c7d23b7"
	I1028 17:56:16.605801  221317 logs.go:123] Gathering logs for kube-proxy [7f02a5ca6f52f299154855b60bcfafa9536ede56364f84c6e92b77d0e7a87fca] ...
	I1028 17:56:16.605914  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7f02a5ca6f52f299154855b60bcfafa9536ede56364f84c6e92b77d0e7a87fca"
	I1028 17:56:16.645499  221317 logs.go:123] Gathering logs for kindnet [c68c99fda2518ff8fdb5438a903a07017af2d8a0eabc9b35d9108e9bacdac080] ...
	I1028 17:56:16.645529  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c68c99fda2518ff8fdb5438a903a07017af2d8a0eabc9b35d9108e9bacdac080"
	I1028 17:56:16.686928  221317 logs.go:123] Gathering logs for kube-apiserver [33189239168a6db46cf78a957ecd5c5a6393840a6cf3c9da6c554d5ed902724d] ...
	I1028 17:56:16.686959  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 33189239168a6db46cf78a957ecd5c5a6393840a6cf3c9da6c554d5ed902724d"
	I1028 17:56:16.743498  221317 logs.go:123] Gathering logs for coredns [8d408e353ef4a8817b92d8b0db58930bbcaeb14974e7659a307541824bfe848e] ...
	I1028 17:56:16.743534  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8d408e353ef4a8817b92d8b0db58930bbcaeb14974e7659a307541824bfe848e"
	I1028 17:56:19.288244  221317 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8443/healthz ...
	I1028 17:56:19.298285  221317 api_server.go:279] https://192.168.85.2:8443/healthz returned 200:
	ok
	I1028 17:56:19.299293  221317 api_server.go:141] control plane version: v1.31.2
	I1028 17:56:19.299320  221317 api_server.go:131] duration metric: took 4.152575279s to wait for apiserver health ...
	I1028 17:56:19.299329  221317 system_pods.go:43] waiting for kube-system pods to appear ...
	I1028 17:56:19.299353  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I1028 17:56:19.299423  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I1028 17:56:19.338226  221317 cri.go:89] found id: "1e1e5cf861857aa712a7ab10a080e52f99bd5985ec00dc21dd9f2a9205855d15"
	I1028 17:56:19.338300  221317 cri.go:89] found id: "33189239168a6db46cf78a957ecd5c5a6393840a6cf3c9da6c554d5ed902724d"
	I1028 17:56:19.338317  221317 cri.go:89] found id: ""
	I1028 17:56:19.338324  221317 logs.go:282] 2 containers: [1e1e5cf861857aa712a7ab10a080e52f99bd5985ec00dc21dd9f2a9205855d15 33189239168a6db46cf78a957ecd5c5a6393840a6cf3c9da6c554d5ed902724d]
	I1028 17:56:19.338388  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.342813  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.346754  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I1028 17:56:19.346869  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I1028 17:56:19.388691  221317 cri.go:89] found id: "9fcea94e303185b679ba542a23301f3dc3318928d26cdded5dd3c30c9153ac0a"
	I1028 17:56:19.388718  221317 cri.go:89] found id: "eae4ed2392aa058002dcbd6b4727d9eda2be826e9d365b59dcbaeda29b58b634"
	I1028 17:56:19.388723  221317 cri.go:89] found id: ""
	I1028 17:56:19.388730  221317 logs.go:282] 2 containers: [9fcea94e303185b679ba542a23301f3dc3318928d26cdded5dd3c30c9153ac0a eae4ed2392aa058002dcbd6b4727d9eda2be826e9d365b59dcbaeda29b58b634]
	I1028 17:56:19.388807  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.392912  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.396236  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I1028 17:56:19.396332  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I1028 17:56:19.432989  221317 cri.go:89] found id: "8d408e353ef4a8817b92d8b0db58930bbcaeb14974e7659a307541824bfe848e"
	I1028 17:56:19.433013  221317 cri.go:89] found id: "d63def5be7d9e46a5562641c82d380a0d5abcc66ad423b6d8c251ed6a42c08f4"
	I1028 17:56:19.433018  221317 cri.go:89] found id: ""
	I1028 17:56:19.433025  221317 logs.go:282] 2 containers: [8d408e353ef4a8817b92d8b0db58930bbcaeb14974e7659a307541824bfe848e d63def5be7d9e46a5562641c82d380a0d5abcc66ad423b6d8c251ed6a42c08f4]
	I1028 17:56:19.433100  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.437132  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.440861  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I1028 17:56:19.440965  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I1028 17:56:19.488803  221317 cri.go:89] found id: "696d41a68acec693cbcfc9f87a485eed897d5ef2f362be96ae60da3f9c7d23b7"
	I1028 17:56:19.488831  221317 cri.go:89] found id: "85bfc5a4f8f33d813eb912381df4cd619f7a3fa3b368a54a796edf28aca5feae"
	I1028 17:56:19.488837  221317 cri.go:89] found id: ""
	I1028 17:56:19.488844  221317 logs.go:282] 2 containers: [696d41a68acec693cbcfc9f87a485eed897d5ef2f362be96ae60da3f9c7d23b7 85bfc5a4f8f33d813eb912381df4cd619f7a3fa3b368a54a796edf28aca5feae]
	I1028 17:56:19.488992  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.493173  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.496821  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I1028 17:56:19.496963  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I1028 17:56:19.544983  221317 cri.go:89] found id: "7f02a5ca6f52f299154855b60bcfafa9536ede56364f84c6e92b77d0e7a87fca"
	I1028 17:56:19.545004  221317 cri.go:89] found id: "9e147e3805aebde63674e97b61d042ee18d5ee2dcef84c36df4f849be35b1990"
	I1028 17:56:19.545008  221317 cri.go:89] found id: ""
	I1028 17:56:19.545016  221317 logs.go:282] 2 containers: [7f02a5ca6f52f299154855b60bcfafa9536ede56364f84c6e92b77d0e7a87fca 9e147e3805aebde63674e97b61d042ee18d5ee2dcef84c36df4f849be35b1990]
	I1028 17:56:19.545072  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.548995  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.552502  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I1028 17:56:19.552618  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I1028 17:56:19.592862  221317 cri.go:89] found id: "db0e6263ce4a2ff18933003f84190449d588b2ca7534114c2d0420303a9ad8e3"
	I1028 17:56:19.592892  221317 cri.go:89] found id: "a3e7fc24d0a6b0dfe25a29286d248f9fb8e6fa1b207e811a3b6aee7f6dc25a22"
	I1028 17:56:19.592898  221317 cri.go:89] found id: ""
	I1028 17:56:19.592905  221317 logs.go:282] 2 containers: [db0e6263ce4a2ff18933003f84190449d588b2ca7534114c2d0420303a9ad8e3 a3e7fc24d0a6b0dfe25a29286d248f9fb8e6fa1b207e811a3b6aee7f6dc25a22]
	I1028 17:56:19.592972  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.597121  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.601181  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I1028 17:56:19.601271  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I1028 17:56:19.641868  221317 cri.go:89] found id: "c68c99fda2518ff8fdb5438a903a07017af2d8a0eabc9b35d9108e9bacdac080"
	I1028 17:56:19.641894  221317 cri.go:89] found id: "efad0295ee7e1fe3c973ea4a3f7a98c72f3d0be5b3d0dee42f0c78f53b76db9f"
	I1028 17:56:19.641901  221317 cri.go:89] found id: ""
	I1028 17:56:19.641908  221317 logs.go:282] 2 containers: [c68c99fda2518ff8fdb5438a903a07017af2d8a0eabc9b35d9108e9bacdac080 efad0295ee7e1fe3c973ea4a3f7a98c72f3d0be5b3d0dee42f0c78f53b76db9f]
	I1028 17:56:19.641991  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.645864  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.650225  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I1028 17:56:19.650327  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I1028 17:56:19.689198  221317 cri.go:89] found id: "45d7397effb45132bfd87686b4f1a1cdc88cbeec8ab86fd7b747f45060f5f2cd"
	I1028 17:56:19.689220  221317 cri.go:89] found id: ""
	I1028 17:56:19.689227  221317 logs.go:282] 1 containers: [45d7397effb45132bfd87686b4f1a1cdc88cbeec8ab86fd7b747f45060f5f2cd]
	I1028 17:56:19.689282  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.692832  221317 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I1028 17:56:19.692901  221317 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I1028 17:56:19.730019  221317 cri.go:89] found id: "488ca23a69b452d0610ad06bc99e9395a13caf8dcfce88e7d09aae9f9de5cdf8"
	I1028 17:56:19.730043  221317 cri.go:89] found id: "f3ce6939c594611802dcee78331360a0842815b0456259a4a45448e6873e9345"
	I1028 17:56:19.730048  221317 cri.go:89] found id: ""
	I1028 17:56:19.730056  221317 logs.go:282] 2 containers: [488ca23a69b452d0610ad06bc99e9395a13caf8dcfce88e7d09aae9f9de5cdf8 f3ce6939c594611802dcee78331360a0842815b0456259a4a45448e6873e9345]
	I1028 17:56:19.730134  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.734594  221317 ssh_runner.go:195] Run: which crictl
	I1028 17:56:19.738486  221317 logs.go:123] Gathering logs for kube-controller-manager [a3e7fc24d0a6b0dfe25a29286d248f9fb8e6fa1b207e811a3b6aee7f6dc25a22] ...
	I1028 17:56:19.738520  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a3e7fc24d0a6b0dfe25a29286d248f9fb8e6fa1b207e811a3b6aee7f6dc25a22"
	I1028 17:56:19.795921  221317 logs.go:123] Gathering logs for storage-provisioner [f3ce6939c594611802dcee78331360a0842815b0456259a4a45448e6873e9345] ...
	I1028 17:56:19.795956  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f3ce6939c594611802dcee78331360a0842815b0456259a4a45448e6873e9345"
	I1028 17:56:19.841179  221317 logs.go:123] Gathering logs for describe nodes ...
	I1028 17:56:19.841208  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 17:56:19.978274  221317 logs.go:123] Gathering logs for coredns [d63def5be7d9e46a5562641c82d380a0d5abcc66ad423b6d8c251ed6a42c08f4] ...
	I1028 17:56:19.978303  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d63def5be7d9e46a5562641c82d380a0d5abcc66ad423b6d8c251ed6a42c08f4"
	I1028 17:56:20.028526  221317 logs.go:123] Gathering logs for kube-scheduler [696d41a68acec693cbcfc9f87a485eed897d5ef2f362be96ae60da3f9c7d23b7] ...
	I1028 17:56:20.028628  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 696d41a68acec693cbcfc9f87a485eed897d5ef2f362be96ae60da3f9c7d23b7"
	I1028 17:56:20.077017  221317 logs.go:123] Gathering logs for kube-scheduler [85bfc5a4f8f33d813eb912381df4cd619f7a3fa3b368a54a796edf28aca5feae] ...
	I1028 17:56:20.077047  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 85bfc5a4f8f33d813eb912381df4cd619f7a3fa3b368a54a796edf28aca5feae"
	I1028 17:56:20.126316  221317 logs.go:123] Gathering logs for kubernetes-dashboard [45d7397effb45132bfd87686b4f1a1cdc88cbeec8ab86fd7b747f45060f5f2cd] ...
	I1028 17:56:20.126357  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 45d7397effb45132bfd87686b4f1a1cdc88cbeec8ab86fd7b747f45060f5f2cd"
	I1028 17:56:20.177609  221317 logs.go:123] Gathering logs for kubelet ...
	I1028 17:56:20.177642  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	I1028 17:56:20.253987  221317 logs.go:123] Gathering logs for kube-apiserver [1e1e5cf861857aa712a7ab10a080e52f99bd5985ec00dc21dd9f2a9205855d15] ...
	I1028 17:56:20.254023  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1e1e5cf861857aa712a7ab10a080e52f99bd5985ec00dc21dd9f2a9205855d15"
	I1028 17:56:20.307316  221317 logs.go:123] Gathering logs for etcd [9fcea94e303185b679ba542a23301f3dc3318928d26cdded5dd3c30c9153ac0a] ...
	I1028 17:56:20.307346  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9fcea94e303185b679ba542a23301f3dc3318928d26cdded5dd3c30c9153ac0a"
	I1028 17:56:20.356355  221317 logs.go:123] Gathering logs for coredns [8d408e353ef4a8817b92d8b0db58930bbcaeb14974e7659a307541824bfe848e] ...
	I1028 17:56:20.356385  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 8d408e353ef4a8817b92d8b0db58930bbcaeb14974e7659a307541824bfe848e"
	I1028 17:56:20.399016  221317 logs.go:123] Gathering logs for kindnet [efad0295ee7e1fe3c973ea4a3f7a98c72f3d0be5b3d0dee42f0c78f53b76db9f] ...
	I1028 17:56:20.399050  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 efad0295ee7e1fe3c973ea4a3f7a98c72f3d0be5b3d0dee42f0c78f53b76db9f"
	I1028 17:56:20.438332  221317 logs.go:123] Gathering logs for storage-provisioner [488ca23a69b452d0610ad06bc99e9395a13caf8dcfce88e7d09aae9f9de5cdf8] ...
	I1028 17:56:20.438361  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 488ca23a69b452d0610ad06bc99e9395a13caf8dcfce88e7d09aae9f9de5cdf8"
	I1028 17:56:20.483352  221317 logs.go:123] Gathering logs for containerd ...
	I1028 17:56:20.483379  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I1028 17:56:20.554278  221317 logs.go:123] Gathering logs for etcd [eae4ed2392aa058002dcbd6b4727d9eda2be826e9d365b59dcbaeda29b58b634] ...
	I1028 17:56:20.554316  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 eae4ed2392aa058002dcbd6b4727d9eda2be826e9d365b59dcbaeda29b58b634"
	I1028 17:56:20.601434  221317 logs.go:123] Gathering logs for kube-proxy [9e147e3805aebde63674e97b61d042ee18d5ee2dcef84c36df4f849be35b1990] ...
	I1028 17:56:20.601476  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9e147e3805aebde63674e97b61d042ee18d5ee2dcef84c36df4f849be35b1990"
	I1028 17:56:20.655227  221317 logs.go:123] Gathering logs for kube-controller-manager [db0e6263ce4a2ff18933003f84190449d588b2ca7534114c2d0420303a9ad8e3] ...
	I1028 17:56:20.655257  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 db0e6263ce4a2ff18933003f84190449d588b2ca7534114c2d0420303a9ad8e3"
	I1028 17:56:20.729038  221317 logs.go:123] Gathering logs for kindnet [c68c99fda2518ff8fdb5438a903a07017af2d8a0eabc9b35d9108e9bacdac080] ...
	I1028 17:56:20.729071  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c68c99fda2518ff8fdb5438a903a07017af2d8a0eabc9b35d9108e9bacdac080"
	I1028 17:56:20.774072  221317 logs.go:123] Gathering logs for dmesg ...
	I1028 17:56:20.774105  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 17:56:20.791187  221317 logs.go:123] Gathering logs for kube-apiserver [33189239168a6db46cf78a957ecd5c5a6393840a6cf3c9da6c554d5ed902724d] ...
	I1028 17:56:20.791215  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 33189239168a6db46cf78a957ecd5c5a6393840a6cf3c9da6c554d5ed902724d"
	I1028 17:56:20.843525  221317 logs.go:123] Gathering logs for kube-proxy [7f02a5ca6f52f299154855b60bcfafa9536ede56364f84c6e92b77d0e7a87fca] ...
	I1028 17:56:20.843560  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7f02a5ca6f52f299154855b60bcfafa9536ede56364f84c6e92b77d0e7a87fca"
	I1028 17:56:20.889321  221317 logs.go:123] Gathering logs for container status ...
	I1028 17:56:20.889347  221317 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 17:56:23.443839  221317 system_pods.go:59] 9 kube-system pods found
	I1028 17:56:23.443879  221317 system_pods.go:61] "coredns-7c65d6cfc9-62xsk" [fda82360-76f5-4f74-8d3c-e46236199c00] Running
	I1028 17:56:23.443886  221317 system_pods.go:61] "etcd-no-preload-671620" [241cfc7c-fa77-4bc6-9847-0b18ac368b31] Running
	I1028 17:56:23.443891  221317 system_pods.go:61] "kindnet-9ngxf" [7a0b8845-43be-440e-b579-6fab8913eb5e] Running
	I1028 17:56:23.443895  221317 system_pods.go:61] "kube-apiserver-no-preload-671620" [4c850cb9-433e-4c98-a887-98a3faa61c3e] Running
	I1028 17:56:23.443899  221317 system_pods.go:61] "kube-controller-manager-no-preload-671620" [f20f2162-cbf6-4822-a65a-b3ac5e439e3a] Running
	I1028 17:56:23.443903  221317 system_pods.go:61] "kube-proxy-2nnd8" [a42f7e2c-c8cc-45bc-97b5-436a3bbea6f5] Running
	I1028 17:56:23.443945  221317 system_pods.go:61] "kube-scheduler-no-preload-671620" [3d0a324d-485f-4e1d-b9af-e2aad21b2db8] Running
	I1028 17:56:23.443962  221317 system_pods.go:61] "metrics-server-6867b74b74-5xptn" [944badca-1aa9-4766-b848-adb80cf31ea7] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I1028 17:56:23.443968  221317 system_pods.go:61] "storage-provisioner" [2e223948-f9a1-45d2-9d5c-5249cd7c994e] Running
	I1028 17:56:23.443976  221317 system_pods.go:74] duration metric: took 4.144640273s to wait for pod list to return data ...
	I1028 17:56:23.443984  221317 default_sa.go:34] waiting for default service account to be created ...
	I1028 17:56:23.447077  221317 default_sa.go:45] found service account: "default"
	I1028 17:56:23.447104  221317 default_sa.go:55] duration metric: took 3.114351ms for default service account to be created ...
	I1028 17:56:23.447114  221317 system_pods.go:116] waiting for k8s-apps to be running ...
	I1028 17:56:23.453733  221317 system_pods.go:86] 9 kube-system pods found
	I1028 17:56:23.453767  221317 system_pods.go:89] "coredns-7c65d6cfc9-62xsk" [fda82360-76f5-4f74-8d3c-e46236199c00] Running
	I1028 17:56:23.453776  221317 system_pods.go:89] "etcd-no-preload-671620" [241cfc7c-fa77-4bc6-9847-0b18ac368b31] Running
	I1028 17:56:23.453781  221317 system_pods.go:89] "kindnet-9ngxf" [7a0b8845-43be-440e-b579-6fab8913eb5e] Running
	I1028 17:56:23.453786  221317 system_pods.go:89] "kube-apiserver-no-preload-671620" [4c850cb9-433e-4c98-a887-98a3faa61c3e] Running
	I1028 17:56:23.453792  221317 system_pods.go:89] "kube-controller-manager-no-preload-671620" [f20f2162-cbf6-4822-a65a-b3ac5e439e3a] Running
	I1028 17:56:23.453796  221317 system_pods.go:89] "kube-proxy-2nnd8" [a42f7e2c-c8cc-45bc-97b5-436a3bbea6f5] Running
	I1028 17:56:23.453800  221317 system_pods.go:89] "kube-scheduler-no-preload-671620" [3d0a324d-485f-4e1d-b9af-e2aad21b2db8] Running
	I1028 17:56:23.453808  221317 system_pods.go:89] "metrics-server-6867b74b74-5xptn" [944badca-1aa9-4766-b848-adb80cf31ea7] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I1028 17:56:23.453818  221317 system_pods.go:89] "storage-provisioner" [2e223948-f9a1-45d2-9d5c-5249cd7c994e] Running
	I1028 17:56:23.453826  221317 system_pods.go:126] duration metric: took 6.706234ms to wait for k8s-apps to be running ...
	I1028 17:56:23.453841  221317 system_svc.go:44] waiting for kubelet service to be running ....
	I1028 17:56:23.453898  221317 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1028 17:56:23.465780  221317 system_svc.go:56] duration metric: took 11.929282ms WaitForService to wait for kubelet
	I1028 17:56:23.465807  221317 kubeadm.go:582] duration metric: took 4m19.06370318s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I1028 17:56:23.465827  221317 node_conditions.go:102] verifying NodePressure condition ...
	I1028 17:56:23.469010  221317 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I1028 17:56:23.469045  221317 node_conditions.go:123] node cpu capacity is 2
	I1028 17:56:23.469058  221317 node_conditions.go:105] duration metric: took 3.225381ms to run NodePressure ...
	I1028 17:56:23.469070  221317 start.go:241] waiting for startup goroutines ...
	I1028 17:56:23.469077  221317 start.go:246] waiting for cluster config update ...
	I1028 17:56:23.469088  221317 start.go:255] writing updated cluster config ...
	I1028 17:56:23.469393  221317 ssh_runner.go:195] Run: rm -f paused
	I1028 17:56:23.536044  221317 start.go:600] kubectl: 1.31.2, cluster: 1.31.2 (minor skew: 0)
	I1028 17:56:23.539095  221317 out.go:177] * Done! kubectl is now configured to use "no-preload-671620" cluster and "default" namespace by default
	I1028 17:56:21.411726  215146 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 17:56:21.424434  215146 api_server.go:72] duration metric: took 5m53.301552069s to wait for apiserver process to appear ...
	I1028 17:56:21.424458  215146 api_server.go:88] waiting for apiserver healthz status ...
	I1028 17:56:21.424495  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I1028 17:56:21.424586  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I1028 17:56:21.462686  215146 cri.go:89] found id: "be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6"
	I1028 17:56:21.462708  215146 cri.go:89] found id: "c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2"
	I1028 17:56:21.462713  215146 cri.go:89] found id: ""
	I1028 17:56:21.462721  215146 logs.go:282] 2 containers: [be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6 c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2]
	I1028 17:56:21.462783  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.466844  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.477116  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I1028 17:56:21.477193  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I1028 17:56:21.528404  215146 cri.go:89] found id: "ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80"
	I1028 17:56:21.528424  215146 cri.go:89] found id: "48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420"
	I1028 17:56:21.528429  215146 cri.go:89] found id: ""
	I1028 17:56:21.528436  215146 logs.go:282] 2 containers: [ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80 48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420]
	I1028 17:56:21.528490  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.532483  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.536429  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I1028 17:56:21.536503  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I1028 17:56:21.577695  215146 cri.go:89] found id: "0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522"
	I1028 17:56:21.577724  215146 cri.go:89] found id: "697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e"
	I1028 17:56:21.577729  215146 cri.go:89] found id: ""
	I1028 17:56:21.577737  215146 logs.go:282] 2 containers: [0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522 697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e]
	I1028 17:56:21.577814  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.581875  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.585396  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I1028 17:56:21.585469  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I1028 17:56:21.626201  215146 cri.go:89] found id: "0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca"
	I1028 17:56:21.626225  215146 cri.go:89] found id: "e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98"
	I1028 17:56:21.626230  215146 cri.go:89] found id: ""
	I1028 17:56:21.626237  215146 logs.go:282] 2 containers: [0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98]
	I1028 17:56:21.626295  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.629990  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.633594  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I1028 17:56:21.633663  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I1028 17:56:21.676659  215146 cri.go:89] found id: "251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b"
	I1028 17:56:21.676682  215146 cri.go:89] found id: "f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1"
	I1028 17:56:21.676687  215146 cri.go:89] found id: ""
	I1028 17:56:21.676694  215146 logs.go:282] 2 containers: [251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1]
	I1028 17:56:21.676753  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.681207  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.684753  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I1028 17:56:21.684826  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I1028 17:56:21.758221  215146 cri.go:89] found id: "45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6"
	I1028 17:56:21.758242  215146 cri.go:89] found id: "07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45"
	I1028 17:56:21.758247  215146 cri.go:89] found id: ""
	I1028 17:56:21.758254  215146 logs.go:282] 2 containers: [45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6 07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45]
	I1028 17:56:21.758309  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.762388  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.765992  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I1028 17:56:21.766050  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I1028 17:56:21.815014  215146 cri.go:89] found id: "281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572"
	I1028 17:56:21.815040  215146 cri.go:89] found id: "eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d"
	I1028 17:56:21.815045  215146 cri.go:89] found id: ""
	I1028 17:56:21.815052  215146 logs.go:282] 2 containers: [281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572 eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d]
	I1028 17:56:21.815108  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.818748  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.822240  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I1028 17:56:21.822340  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I1028 17:56:21.865838  215146 cri.go:89] found id: "616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245"
	I1028 17:56:21.865901  215146 cri.go:89] found id: ""
	I1028 17:56:21.865916  215146 logs.go:282] 1 containers: [616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245]
	I1028 17:56:21.865971  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.870830  215146 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I1028 17:56:21.870949  215146 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I1028 17:56:21.910658  215146 cri.go:89] found id: "1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220"
	I1028 17:56:21.910685  215146 cri.go:89] found id: "7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78"
	I1028 17:56:21.910689  215146 cri.go:89] found id: ""
	I1028 17:56:21.910699  215146 logs.go:282] 2 containers: [1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220 7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78]
	I1028 17:56:21.910774  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.914374  215146 ssh_runner.go:195] Run: which crictl
	I1028 17:56:21.917740  215146 logs.go:123] Gathering logs for kube-scheduler [e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98] ...
	I1028 17:56:21.917766  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98"
	I1028 17:56:21.958055  215146 logs.go:123] Gathering logs for kubernetes-dashboard [616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245] ...
	I1028 17:56:21.958089  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245"
	I1028 17:56:22.000135  215146 logs.go:123] Gathering logs for storage-provisioner [1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220] ...
	I1028 17:56:22.000162  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220"
	I1028 17:56:22.043187  215146 logs.go:123] Gathering logs for kubelet ...
	I1028 17:56:22.043217  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W1028 17:56:22.097360  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.823989     666 reflector.go:138] object-"kube-system"/"metrics-server-token-s8546": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-s8546" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.097593  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.825360     666 reflector.go:138] object-"kube-system"/"kindnet-token-rzkm7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-rzkm7" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.097805  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.826686     666 reflector.go:138] object-"kube-system"/"coredns-token-bhrx5": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-bhrx5" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.098006  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.827119     666 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.098222  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.827457     666 reflector.go:138] object-"kube-system"/"kube-proxy-token-j55lg": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-j55lg" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.100682  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.862535     666 reflector.go:138] object-"kube-system"/"storage-provisioner-token-42rw4": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-42rw4" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.100895  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.862690     666 reflector.go:138] object-"default"/"default-token-8g42r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-8g42r" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.102299  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:48 old-k8s-version-743648 kubelet[666]: E1028 17:50:48.862027     666 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-743648" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-743648' and this object
	W1028 17:56:22.110663  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:52 old-k8s-version-743648 kubelet[666]: E1028 17:50:52.034873     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:22.110853  215146 logs.go:138] Found kubelet problem: Oct 28 17:50:52 old-k8s-version-743648 kubelet[666]: E1028 17:50:52.426336     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.113643  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:04 old-k8s-version-743648 kubelet[666]: E1028 17:51:04.181734     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:22.115310  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:15 old-k8s-version-743648 kubelet[666]: E1028 17:51:15.145992     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.116227  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:20 old-k8s-version-743648 kubelet[666]: E1028 17:51:20.589441     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.116583  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:21 old-k8s-version-743648 kubelet[666]: E1028 17:51:21.593639     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.117028  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:23 old-k8s-version-743648 kubelet[666]: E1028 17:51:23.609906     666 pod_workers.go:191] Error syncing pod 8ffc3abd-c784-474f-80a5-f6a8b25abc51 ("storage-provisioner_kube-system(8ffc3abd-c784-474f-80a5-f6a8b25abc51)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(8ffc3abd-c784-474f-80a5-f6a8b25abc51)"
	W1028 17:56:22.117353  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:25 old-k8s-version-743648 kubelet[666]: E1028 17:51:25.775266     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.120160  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:29 old-k8s-version-743648 kubelet[666]: E1028 17:51:29.147486     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:22.120698  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:41 old-k8s-version-743648 kubelet[666]: E1028 17:51:41.138852     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.121161  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:41 old-k8s-version-743648 kubelet[666]: E1028 17:51:41.660884     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.121488  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:45 old-k8s-version-743648 kubelet[666]: E1028 17:51:45.774632     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.121670  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:52 old-k8s-version-743648 kubelet[666]: E1028 17:51:52.138242     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.121998  215146 logs.go:138] Found kubelet problem: Oct 28 17:51:59 old-k8s-version-743648 kubelet[666]: E1028 17:51:59.137591     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.122182  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:05 old-k8s-version-743648 kubelet[666]: E1028 17:52:05.138208     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.122765  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:14 old-k8s-version-743648 kubelet[666]: E1028 17:52:14.756224     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.123092  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:15 old-k8s-version-743648 kubelet[666]: E1028 17:52:15.774720     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.125572  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:17 old-k8s-version-743648 kubelet[666]: E1028 17:52:17.148693     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:22.125906  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:28 old-k8s-version-743648 kubelet[666]: E1028 17:52:28.141800     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.126094  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:32 old-k8s-version-743648 kubelet[666]: E1028 17:52:32.138343     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.126423  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:40 old-k8s-version-743648 kubelet[666]: E1028 17:52:40.138205     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.126605  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:44 old-k8s-version-743648 kubelet[666]: E1028 17:52:44.140775     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.127190  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:55 old-k8s-version-743648 kubelet[666]: E1028 17:52:55.867579     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.127374  215146 logs.go:138] Found kubelet problem: Oct 28 17:52:58 old-k8s-version-743648 kubelet[666]: E1028 17:52:58.138213     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.127698  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:05 old-k8s-version-743648 kubelet[666]: E1028 17:53:05.775406     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.127885  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:13 old-k8s-version-743648 kubelet[666]: E1028 17:53:13.138098     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.128213  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:17 old-k8s-version-743648 kubelet[666]: E1028 17:53:17.137660     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.128398  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:25 old-k8s-version-743648 kubelet[666]: E1028 17:53:25.138080     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.128741  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:28 old-k8s-version-743648 kubelet[666]: E1028 17:53:28.141572     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.131182  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:39 old-k8s-version-743648 kubelet[666]: E1028 17:53:39.147007     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W1028 17:56:22.131510  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:43 old-k8s-version-743648 kubelet[666]: E1028 17:53:43.137608     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.131694  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:52 old-k8s-version-743648 kubelet[666]: E1028 17:53:52.138963     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.132018  215146 logs.go:138] Found kubelet problem: Oct 28 17:53:57 old-k8s-version-743648 kubelet[666]: E1028 17:53:57.137666     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.132200  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:03 old-k8s-version-743648 kubelet[666]: E1028 17:54:03.139810     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.132523  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:08 old-k8s-version-743648 kubelet[666]: E1028 17:54:08.137748     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.132714  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:15 old-k8s-version-743648 kubelet[666]: E1028 17:54:15.138210     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.133317  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:22 old-k8s-version-743648 kubelet[666]: E1028 17:54:22.110858     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.133641  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:25 old-k8s-version-743648 kubelet[666]: E1028 17:54:25.774510     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.133824  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:26 old-k8s-version-743648 kubelet[666]: E1028 17:54:26.142477     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.134153  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:36 old-k8s-version-743648 kubelet[666]: E1028 17:54:36.140263     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.134335  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:40 old-k8s-version-743648 kubelet[666]: E1028 17:54:40.138696     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.134661  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:51 old-k8s-version-743648 kubelet[666]: E1028 17:54:51.137643     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.134843  215146 logs.go:138] Found kubelet problem: Oct 28 17:54:54 old-k8s-version-743648 kubelet[666]: E1028 17:54:54.140745     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.135171  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:05 old-k8s-version-743648 kubelet[666]: E1028 17:55:05.137675     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.135355  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:06 old-k8s-version-743648 kubelet[666]: E1028 17:55:06.141555     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.135679  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:18 old-k8s-version-743648 kubelet[666]: E1028 17:55:18.142304     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.135860  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:18 old-k8s-version-743648 kubelet[666]: E1028 17:55:18.144881     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.136044  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:30 old-k8s-version-743648 kubelet[666]: E1028 17:55:30.145457     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.136368  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:30 old-k8s-version-743648 kubelet[666]: E1028 17:55:30.148252     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.136701  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.143236     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.136883  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.149385     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.137231  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:56 old-k8s-version-743648 kubelet[666]: E1028 17:55:56.138548     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.137419  215146 logs.go:138] Found kubelet problem: Oct 28 17:55:59 old-k8s-version-743648 kubelet[666]: E1028 17:55:59.138036     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:22.137747  215146 logs.go:138] Found kubelet problem: Oct 28 17:56:11 old-k8s-version-743648 kubelet[666]: E1028 17:56:11.140245     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:22.137930  215146 logs.go:138] Found kubelet problem: Oct 28 17:56:13 old-k8s-version-743648 kubelet[666]: E1028 17:56:13.138081     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I1028 17:56:22.137946  215146 logs.go:123] Gathering logs for dmesg ...
	I1028 17:56:22.137960  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I1028 17:56:22.158369  215146 logs.go:123] Gathering logs for kube-apiserver [be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6] ...
	I1028 17:56:22.158447  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6"
	I1028 17:56:22.213784  215146 logs.go:123] Gathering logs for kube-apiserver [c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2] ...
	I1028 17:56:22.213817  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2"
	I1028 17:56:22.279566  215146 logs.go:123] Gathering logs for coredns [0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522] ...
	I1028 17:56:22.279609  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522"
	I1028 17:56:22.320096  215146 logs.go:123] Gathering logs for storage-provisioner [7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78] ...
	I1028 17:56:22.320123  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78"
	I1028 17:56:22.366694  215146 logs.go:123] Gathering logs for kindnet [281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572] ...
	I1028 17:56:22.366732  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572"
	I1028 17:56:22.417133  215146 logs.go:123] Gathering logs for describe nodes ...
	I1028 17:56:22.417163  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I1028 17:56:22.575425  215146 logs.go:123] Gathering logs for coredns [697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e] ...
	I1028 17:56:22.575457  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e"
	I1028 17:56:22.613582  215146 logs.go:123] Gathering logs for kube-proxy [251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b] ...
	I1028 17:56:22.613610  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b"
	I1028 17:56:22.660854  215146 logs.go:123] Gathering logs for kube-controller-manager [45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6] ...
	I1028 17:56:22.660882  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6"
	I1028 17:56:22.717997  215146 logs.go:123] Gathering logs for kube-controller-manager [07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45] ...
	I1028 17:56:22.718031  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45"
	I1028 17:56:22.775654  215146 logs.go:123] Gathering logs for etcd [ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80] ...
	I1028 17:56:22.775689  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80"
	I1028 17:56:22.829841  215146 logs.go:123] Gathering logs for etcd [48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420] ...
	I1028 17:56:22.829880  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420"
	I1028 17:56:22.873201  215146 logs.go:123] Gathering logs for kube-proxy [f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1] ...
	I1028 17:56:22.873231  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1"
	I1028 17:56:22.917373  215146 logs.go:123] Gathering logs for container status ...
	I1028 17:56:22.917399  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I1028 17:56:22.966858  215146 logs.go:123] Gathering logs for kube-scheduler [0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca] ...
	I1028 17:56:22.966891  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca"
	I1028 17:56:23.010694  215146 logs.go:123] Gathering logs for kindnet [eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d] ...
	I1028 17:56:23.010731  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d"
	I1028 17:56:23.069106  215146 logs.go:123] Gathering logs for containerd ...
	I1028 17:56:23.069137  215146 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I1028 17:56:23.132899  215146 out.go:358] Setting ErrFile to fd 2...
	I1028 17:56:23.132932  215146 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W1028 17:56:23.133001  215146 out.go:270] X Problems detected in kubelet:
	W1028 17:56:23.133017  215146 out.go:270]   Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.149385     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:23.133051  215146 out.go:270]   Oct 28 17:55:56 old-k8s-version-743648 kubelet[666]: E1028 17:55:56.138548     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:23.133060  215146 out.go:270]   Oct 28 17:55:59 old-k8s-version-743648 kubelet[666]: E1028 17:55:59.138036     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W1028 17:56:23.133067  215146 out.go:270]   Oct 28 17:56:11 old-k8s-version-743648 kubelet[666]: E1028 17:56:11.140245     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	W1028 17:56:23.133073  215146 out.go:270]   Oct 28 17:56:13 old-k8s-version-743648 kubelet[666]: E1028 17:56:13.138081     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I1028 17:56:23.133082  215146 out.go:358] Setting ErrFile to fd 2...
	I1028 17:56:23.133089  215146 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:56:33.134758  215146 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I1028 17:56:33.146466  215146 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
	ok
	I1028 17:56:33.148907  215146 out.go:201] 
	W1028 17:56:33.150944  215146 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	W1028 17:56:33.150988  215146 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
	W1028 17:56:33.151008  215146 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
	W1028 17:56:33.151018  215146 out.go:270] * 
	W1028 17:56:33.151915  215146 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I1028 17:56:33.154167  215146 out.go:201] 
	
	
	==> container status <==
	CONTAINER           IMAGE               CREATED             STATE               NAME                        ATTEMPT             POD ID              POD
	97a314c29d1a7       523cad1a4df73       2 minutes ago       Exited              dashboard-metrics-scraper   5                   06ed3d331b5d6       dashboard-metrics-scraper-8d5bb5db8-jx67q
	1aef6c7a01064       ba04bb24b9575       4 minutes ago       Running             storage-provisioner         2                   7eb25643f176f       storage-provisioner
	616276ec12d45       20b332c9a70d8       5 minutes ago       Running             kubernetes-dashboard        0                   aac3897da3c92       kubernetes-dashboard-cd95d586-k2vc6
	251d74de7c72a       25a5233254979       5 minutes ago       Running             kube-proxy                  1                   d4a324f2431ae       kube-proxy-zzhjw
	2db1c67b9f816       1611cd07b61d5       5 minutes ago       Running             busybox                     1                   773961302937b       busybox
	0e45eb02d6ef2       db91994f4ee8f       5 minutes ago       Running             coredns                     1                   817eccfb2e131       coredns-74ff55c5b-97b6q
	7dafca8166996       ba04bb24b9575       5 minutes ago       Exited              storage-provisioner         1                   7eb25643f176f       storage-provisioner
	281df8d7ccec7       0bcd66b03df5f       5 minutes ago       Running             kindnet-cni                 1                   a63b55d8dd3ce       kindnet-dzxmm
	45d2c62bb3793       1df8a2b116bd1       5 minutes ago       Running             kube-controller-manager     1                   78a459fa030a6       kube-controller-manager-old-k8s-version-743648
	be449cd4e4ecc       2c08bbbc02d3a       5 minutes ago       Running             kube-apiserver              1                   5e7d27c67de9a       kube-apiserver-old-k8s-version-743648
	ef0e952b69c48       05b738aa1bc63       5 minutes ago       Running             etcd                        1                   61926a97b89c1       etcd-old-k8s-version-743648
	0f6d7fac26d93       e7605f88f17d6       5 minutes ago       Running             kube-scheduler              1                   805065fb9e562       kube-scheduler-old-k8s-version-743648
	c8b4ccecdd3e1       1611cd07b61d5       6 minutes ago       Exited              busybox                     0                   ed7e59b9876b7       busybox
	697a2238311c1       db91994f4ee8f       7 minutes ago       Exited              coredns                     0                   e06d960001c29       coredns-74ff55c5b-97b6q
	eef038eb4862c       0bcd66b03df5f       8 minutes ago       Exited              kindnet-cni                 0                   d226fda483eb3       kindnet-dzxmm
	f8257840a24c6       25a5233254979       8 minutes ago       Exited              kube-proxy                  0                   e246b9714ae6e       kube-proxy-zzhjw
	48a3894d832c5       05b738aa1bc63       8 minutes ago       Exited              etcd                        0                   aa519b5e3370b       etcd-old-k8s-version-743648
	e659d3edb50ed       e7605f88f17d6       8 minutes ago       Exited              kube-scheduler              0                   174d71dab1973       kube-scheduler-old-k8s-version-743648
	07fd4f4cf88e3       1df8a2b116bd1       8 minutes ago       Exited              kube-controller-manager     0                   b213618d19880       kube-controller-manager-old-k8s-version-743648
	c2a071551dfcc       2c08bbbc02d3a       8 minutes ago       Exited              kube-apiserver              0                   f0d2a2848a7ba       kube-apiserver-old-k8s-version-743648
	
	
	==> containerd <==
	Oct 28 17:52:55 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:52:55.183027902Z" level=info msg="CreateContainer within sandbox \"06ed3d331b5d617b962e3d7de3eda2fd506bb6545a42d0fadfd021e1f5015d43\" for name:\"dashboard-metrics-scraper\"  attempt:4 returns container id \"3bda48baa7560e5104b44770d96516c65c8e186c85ef7aed71f630710ed775c0\""
	Oct 28 17:52:55 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:52:55.184002886Z" level=info msg="StartContainer for \"3bda48baa7560e5104b44770d96516c65c8e186c85ef7aed71f630710ed775c0\""
	Oct 28 17:52:55 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:52:55.265876987Z" level=info msg="StartContainer for \"3bda48baa7560e5104b44770d96516c65c8e186c85ef7aed71f630710ed775c0\" returns successfully"
	Oct 28 17:52:55 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:52:55.300236928Z" level=info msg="shim disconnected" id=3bda48baa7560e5104b44770d96516c65c8e186c85ef7aed71f630710ed775c0 namespace=k8s.io
	Oct 28 17:52:55 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:52:55.300310650Z" level=warning msg="cleaning up after shim disconnected" id=3bda48baa7560e5104b44770d96516c65c8e186c85ef7aed71f630710ed775c0 namespace=k8s.io
	Oct 28 17:52:55 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:52:55.300328881Z" level=info msg="cleaning up dead shim" namespace=k8s.io
	Oct 28 17:52:55 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:52:55.872193804Z" level=info msg="RemoveContainer for \"a6758e5ea5ab8a3b92ae51b01fcce378fd3fb591d0be0af560c4ae6f86e03708\""
	Oct 28 17:52:55 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:52:55.878356323Z" level=info msg="RemoveContainer for \"a6758e5ea5ab8a3b92ae51b01fcce378fd3fb591d0be0af560c4ae6f86e03708\" returns successfully"
	Oct 28 17:53:39 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:53:39.138978872Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Oct 28 17:53:39 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:53:39.144784383Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
	Oct 28 17:53:39 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:53:39.146518413Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	Oct 28 17:53:39 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:53:39.146652065Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
	Oct 28 17:54:21 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:54:21.139884528Z" level=info msg="CreateContainer within sandbox \"06ed3d331b5d617b962e3d7de3eda2fd506bb6545a42d0fadfd021e1f5015d43\" for container name:\"dashboard-metrics-scraper\"  attempt:5"
	Oct 28 17:54:21 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:54:21.156281312Z" level=info msg="CreateContainer within sandbox \"06ed3d331b5d617b962e3d7de3eda2fd506bb6545a42d0fadfd021e1f5015d43\" for name:\"dashboard-metrics-scraper\"  attempt:5 returns container id \"97a314c29d1a7bf3d28628be00c27d765855c61ba2697a31be56b8830b3fbf2f\""
	Oct 28 17:54:21 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:54:21.157091023Z" level=info msg="StartContainer for \"97a314c29d1a7bf3d28628be00c27d765855c61ba2697a31be56b8830b3fbf2f\""
	Oct 28 17:54:21 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:54:21.220734745Z" level=info msg="StartContainer for \"97a314c29d1a7bf3d28628be00c27d765855c61ba2697a31be56b8830b3fbf2f\" returns successfully"
	Oct 28 17:54:21 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:54:21.255515271Z" level=info msg="shim disconnected" id=97a314c29d1a7bf3d28628be00c27d765855c61ba2697a31be56b8830b3fbf2f namespace=k8s.io
	Oct 28 17:54:21 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:54:21.255586244Z" level=warning msg="cleaning up after shim disconnected" id=97a314c29d1a7bf3d28628be00c27d765855c61ba2697a31be56b8830b3fbf2f namespace=k8s.io
	Oct 28 17:54:21 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:54:21.255595778Z" level=info msg="cleaning up dead shim" namespace=k8s.io
	Oct 28 17:54:22 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:54:22.112781372Z" level=info msg="RemoveContainer for \"3bda48baa7560e5104b44770d96516c65c8e186c85ef7aed71f630710ed775c0\""
	Oct 28 17:54:22 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:54:22.126976851Z" level=info msg="RemoveContainer for \"3bda48baa7560e5104b44770d96516c65c8e186c85ef7aed71f630710ed775c0\" returns successfully"
	Oct 28 17:56:25 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:56:25.139032795Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Oct 28 17:56:25 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:56:25.155819968Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
	Oct 28 17:56:25 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:56:25.157924085Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	Oct 28 17:56:25 old-k8s-version-743648 containerd[571]: time="2024-10-28T17:56:25.157948897Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
	
	
	==> coredns [0e45eb02d6ef238469955efda1ee7684d106fb78843e77c663a6530e9a4ce522] <==
	I1028 17:51:22.780161       1 trace.go:116] Trace[2019727887]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-10-28 17:50:52.779480133 +0000 UTC m=+0.070982856) (total time: 30.000503609s):
	Trace[2019727887]: [30.000503609s] [30.000503609s] END
	E1028 17:51:22.780493       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	I1028 17:51:22.780515       1 trace.go:116] Trace[939984059]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-10-28 17:50:52.779950804 +0000 UTC m=+0.071453528) (total time: 30.000553987s):
	Trace[939984059]: [30.000553987s] [30.000553987s] END
	E1028 17:51:22.780786       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	I1028 17:51:22.780432       1 trace.go:116] Trace[1427131847]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125 (started: 2024-10-28 17:50:52.780154453 +0000 UTC m=+0.071657176) (total time: 30.000259592s):
	Trace[1427131847]: [30.000259592s] [30.000259592s] END
	E1028 17:51:22.780989       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.3/tools/cache/reflector.go:125: Failed to list *v1.Endpoints: Get "https://10.96.0.1:443/api/v1/endpoints?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	.:53
	[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
	CoreDNS-1.7.0
	linux/arm64, go1.14.4, f59c03d
	[INFO] 127.0.0.1:35993 - 60538 "HINFO IN 6197028704380980754.310336088400240551. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.024373997s
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	
	
	==> coredns [697a2238311c1986504052595cca9231d4b6ae089cc7a1e5ea057443459f150e] <==
	.:53
	[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
	CoreDNS-1.7.0
	linux/arm64, go1.14.4, f59c03d
	[INFO] 127.0.0.1:46363 - 7131 "HINFO IN 4792780249260431917.4391253746878207862. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.006161507s
	
	
	==> describe nodes <==
	Name:               old-k8s-version-743648
	Roles:              control-plane,master
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=old-k8s-version-743648
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=eb485f4d2e746257bc08ad8e2f39a06044008ba8
	                    minikube.k8s.io/name=old-k8s-version-743648
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_10_28T17_48_13_0700
	                    minikube.k8s.io/version=v1.34.0
	                    node-role.kubernetes.io/control-plane=
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 28 Oct 2024 17:48:09 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  old-k8s-version-743648
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 28 Oct 2024 17:56:31 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 28 Oct 2024 17:51:39 +0000   Mon, 28 Oct 2024 17:48:02 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 28 Oct 2024 17:51:39 +0000   Mon, 28 Oct 2024 17:48:02 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 28 Oct 2024 17:51:39 +0000   Mon, 28 Oct 2024 17:48:02 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 28 Oct 2024 17:51:39 +0000   Mon, 28 Oct 2024 17:50:49 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.76.2
	  Hostname:    old-k8s-version-743648
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022300Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022300Ki
	  pods:               110
	System Info:
	  Machine ID:                 e6b796c4563046fd97f17ef541c604e7
	  System UUID:                b6d54d77-f5c8-48c8-a0c4-ee74c7ae873a
	  Boot ID:                    a43c4fe7-73f5-4eea-81c4-9720365cd829
	  Kernel Version:             5.15.0-1071-aws
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  containerd://1.7.22
	  Kubelet Version:            v1.20.0
	  Kube-Proxy Version:         v1.20.0
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (12 in total)
	  Namespace                   Name                                              CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                   ----                                              ------------  ----------  ---------------  -------------  ---
	  default                     busybox                                           0 (0%)        0 (0%)      0 (0%)           0 (0%)         6m38s
	  kube-system                 coredns-74ff55c5b-97b6q                           100m (5%)     0 (0%)      70Mi (0%)        170Mi (2%)     8m7s
	  kube-system                 etcd-old-k8s-version-743648                       100m (5%)     0 (0%)      100Mi (1%)       0 (0%)         8m13s
	  kube-system                 kindnet-dzxmm                                     100m (5%)     100m (5%)   50Mi (0%)        50Mi (0%)      8m7s
	  kube-system                 kube-apiserver-old-k8s-version-743648             250m (12%)    0 (0%)      0 (0%)           0 (0%)         8m13s
	  kube-system                 kube-controller-manager-old-k8s-version-743648    200m (10%)    0 (0%)      0 (0%)           0 (0%)         8m13s
	  kube-system                 kube-proxy-zzhjw                                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         8m7s
	  kube-system                 kube-scheduler-old-k8s-version-743648             100m (5%)     0 (0%)      0 (0%)           0 (0%)         8m13s
	  kube-system                 metrics-server-9975d5f86-4qgm8                    100m (5%)     0 (0%)      200Mi (2%)       0 (0%)         6m27s
	  kube-system                 storage-provisioner                               0 (0%)        0 (0%)      0 (0%)           0 (0%)         8m5s
	  kubernetes-dashboard        dashboard-metrics-scraper-8d5bb5db8-jx67q         0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m25s
	  kubernetes-dashboard        kubernetes-dashboard-cd95d586-k2vc6               0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m25s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (47%)  100m (5%)
	  memory             420Mi (5%)  220Mi (2%)
	  ephemeral-storage  100Mi (0%)  0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	  hugepages-32Mi     0 (0%)      0 (0%)
	  hugepages-64Ki     0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                    From        Message
	  ----    ------                   ----                   ----        -------
	  Normal  NodeHasSufficientMemory  8m33s (x5 over 8m33s)  kubelet     Node old-k8s-version-743648 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    8m33s (x5 over 8m33s)  kubelet     Node old-k8s-version-743648 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     8m33s (x4 over 8m33s)  kubelet     Node old-k8s-version-743648 status is now: NodeHasSufficientPID
	  Normal  Starting                 8m14s                  kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  8m14s                  kubelet     Node old-k8s-version-743648 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    8m14s                  kubelet     Node old-k8s-version-743648 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     8m14s                  kubelet     Node old-k8s-version-743648 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  8m13s                  kubelet     Updated Node Allocatable limit across pods
	  Normal  NodeReady                8m7s                   kubelet     Node old-k8s-version-743648 status is now: NodeReady
	  Normal  Starting                 8m5s                   kube-proxy  Starting kube-proxy.
	  Normal  Starting                 5m58s                  kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  5m58s (x8 over 5m58s)  kubelet     Node old-k8s-version-743648 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    5m58s (x8 over 5m58s)  kubelet     Node old-k8s-version-743648 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     5m58s (x7 over 5m58s)  kubelet     Node old-k8s-version-743648 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  5m58s                  kubelet     Updated Node Allocatable limit across pods
	  Normal  Starting                 5m41s                  kube-proxy  Starting kube-proxy.
	
	
	==> dmesg <==
	[Oct28 16:17] ACPI: SRAT not present
	[  +0.000000] ACPI: SRAT not present
	[  +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
	[  +0.014925] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
	[  +0.483288] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
	[  +0.028373] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
	[  +0.032276] systemd[1]: /lib/systemd/system/cloud-init.service:20: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
	[  +0.019435] systemd[1]: /lib/systemd/system/cloud-init-hotplugd.socket:11: Unknown key name 'ConditionEnvironment' in section 'Unit', ignoring.
	[  +0.671496] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
	[  +6.413135] kauditd_printk_skb: 34 callbacks suppressed
	[Oct28 17:17] hrtimer: interrupt took 9249663 ns
	[Oct28 17:40] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
	
	
	==> etcd [48a3894d832c52de4abeaef07543d9a0e58a0ab2dc79dc5335df2fe638fa8420] <==
	raft2024/10/28 17:48:03 INFO: ea7e25599daad906 is starting a new election at term 1
	raft2024/10/28 17:48:03 INFO: ea7e25599daad906 became candidate at term 2
	raft2024/10/28 17:48:03 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
	raft2024/10/28 17:48:03 INFO: ea7e25599daad906 became leader at term 2
	raft2024/10/28 17:48:03 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
	2024-10-28 17:48:03.527351 I | etcdserver: setting up the initial cluster version to 3.4
	2024-10-28 17:48:03.529839 N | etcdserver/membership: set the initial cluster version to 3.4
	2024-10-28 17:48:03.530252 I | etcdserver/api: enabled capabilities for version 3.4
	2024-10-28 17:48:03.530376 I | etcdserver: published {Name:old-k8s-version-743648 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
	2024-10-28 17:48:03.530470 I | embed: ready to serve client requests
	2024-10-28 17:48:03.532204 I | embed: serving client requests on 127.0.0.1:2379
	2024-10-28 17:48:03.532500 I | embed: ready to serve client requests
	2024-10-28 17:48:03.539573 I | embed: serving client requests on 192.168.76.2:2379
	2024-10-28 17:48:21.777795 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:48:27.005759 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:48:37.009525 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:48:47.006660 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:48:57.007130 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:49:07.007511 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:49:17.006130 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:49:27.006506 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:49:37.007874 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:49:47.008087 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:49:57.008033 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:50:07.014372 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	
	
	==> etcd [ef0e952b69c48532fae761ffded3c4007687b28e682a598ada510d32c607af80] <==
	2024-10-28 17:52:33.330698 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:52:43.330777 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:52:53.330641 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:53:03.330786 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:53:13.330677 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:53:23.330718 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:53:33.330689 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:53:43.330565 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:53:53.330813 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:54:03.330797 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:54:13.330649 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:54:23.335400 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:54:33.330688 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:54:43.330840 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:54:53.330780 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:55:03.330703 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:55:13.330851 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:55:23.330653 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:55:33.330684 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:55:43.330706 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:55:53.330898 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:56:03.330711 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:56:13.331075 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:56:23.331009 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-10-28 17:56:33.330990 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	
	
	==> kernel <==
	 17:56:35 up  1:39,  0 users,  load average: 0.29, 1.36, 1.99
	Linux old-k8s-version-743648 5.15.0-1071-aws #77~20.04.1-Ubuntu SMP Thu Oct 3 19:34:36 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [281df8d7ccec716f0fc1c8e942acef13277e5fa97077ae40c404e6d69dda5572] <==
	I1028 17:54:32.924257       1 main.go:300] handling current node
	I1028 17:54:42.925415       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:54:42.925509       1 main.go:300] handling current node
	I1028 17:54:52.920204       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:54:52.920241       1 main.go:300] handling current node
	I1028 17:55:02.921795       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:55:02.921827       1 main.go:300] handling current node
	I1028 17:55:12.928862       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:55:12.928897       1 main.go:300] handling current node
	I1028 17:55:22.921111       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:55:22.921203       1 main.go:300] handling current node
	I1028 17:55:32.925180       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:55:32.925225       1 main.go:300] handling current node
	I1028 17:55:42.927488       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:55:42.927526       1 main.go:300] handling current node
	I1028 17:55:52.919108       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:55:52.919144       1 main.go:300] handling current node
	I1028 17:56:02.925579       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:56:02.925614       1 main.go:300] handling current node
	I1028 17:56:12.928652       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:56:12.928687       1 main.go:300] handling current node
	I1028 17:56:22.928646       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:56:22.928677       1 main.go:300] handling current node
	I1028 17:56:32.920842       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:56:32.920880       1 main.go:300] handling current node
	
	
	==> kindnet [eef038eb4862c59e275e52ad2ccc7e110478d7d67b0ed0af7e26ca0f5159430d] <==
	I1028 17:48:31.621158       1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
	I1028 17:48:31.917755       1 controller.go:338] Starting controller kube-network-policies
	I1028 17:48:31.917848       1 controller.go:342] Waiting for informer caches to sync
	I1028 17:48:31.918437       1 shared_informer.go:313] Waiting for caches to sync for kube-network-policies
	I1028 17:48:32.120649       1 shared_informer.go:320] Caches are synced for kube-network-policies
	I1028 17:48:32.120675       1 metrics.go:61] Registering metrics
	I1028 17:48:32.120721       1 controller.go:378] Syncing nftables rules
	I1028 17:48:41.920675       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:48:41.920757       1 main.go:300] handling current node
	I1028 17:48:51.917849       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:48:51.917890       1 main.go:300] handling current node
	I1028 17:49:01.925726       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:49:01.925766       1 main.go:300] handling current node
	I1028 17:49:11.926536       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:49:11.926575       1 main.go:300] handling current node
	I1028 17:49:21.917597       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:49:21.917632       1 main.go:300] handling current node
	I1028 17:49:31.918638       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:49:31.918673       1 main.go:300] handling current node
	I1028 17:49:41.926679       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:49:41.926712       1 main.go:300] handling current node
	I1028 17:49:51.923849       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:49:51.923884       1 main.go:300] handling current node
	I1028 17:50:01.917608       1 main.go:296] Handling node with IPs: map[192.168.76.2:{}]
	I1028 17:50:01.917650       1 main.go:300] handling current node
	
	
	==> kube-apiserver [be449cd4e4ecc581a0ca9ed37c8fda624d9f4250c08451fefe3886e4322c02b6] <==
	I1028 17:53:07.219337       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I1028 17:53:07.219346       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I1028 17:53:42.761182       1 client.go:360] parsed scheme: "passthrough"
	I1028 17:53:42.761297       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I1028 17:53:42.761335       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	W1028 17:53:52.835637       1 handler_proxy.go:102] no RequestInfo found in the context
	E1028 17:53:52.835729       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I1028 17:53:52.835749       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I1028 17:54:15.931701       1 client.go:360] parsed scheme: "passthrough"
	I1028 17:54:15.931745       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I1028 17:54:15.931956       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I1028 17:54:55.175043       1 client.go:360] parsed scheme: "passthrough"
	I1028 17:54:55.175089       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I1028 17:54:55.175098       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I1028 17:55:38.015551       1 client.go:360] parsed scheme: "passthrough"
	I1028 17:55:38.016746       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I1028 17:55:38.016788       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	W1028 17:55:49.867709       1 handler_proxy.go:102] no RequestInfo found in the context
	E1028 17:55:49.867975       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I1028 17:55:49.868003       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I1028 17:56:11.169962       1 client.go:360] parsed scheme: "passthrough"
	I1028 17:56:11.170007       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I1028 17:56:11.170016       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	
	
	==> kube-apiserver [c2a071551dfccbcb237c217f313624253b80441d6a33cd928338054bbfa893f2] <==
	I1028 17:48:09.236059       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I1028 17:48:09.236112       1 apf_controller.go:253] Running API Priority and Fairness config worker
	I1028 17:48:09.292048       1 controller.go:606] quota admission added evaluator for: namespaces
	I1028 17:48:09.963307       1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I1028 17:48:09.963334       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I1028 17:48:09.971698       1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
	I1028 17:48:09.976072       1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
	I1028 17:48:09.976102       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
	I1028 17:48:10.498168       1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I1028 17:48:10.553008       1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W1028 17:48:10.679708       1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
	I1028 17:48:10.680973       1 controller.go:606] quota admission added evaluator for: endpoints
	I1028 17:48:10.685151       1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I1028 17:48:10.963509       1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
	I1028 17:48:11.689860       1 controller.go:606] quota admission added evaluator for: serviceaccounts
	I1028 17:48:12.405487       1 controller.go:606] quota admission added evaluator for: deployments.apps
	I1028 17:48:12.489839       1 controller.go:606] quota admission added evaluator for: daemonsets.apps
	I1028 17:48:27.761752       1 controller.go:606] quota admission added evaluator for: replicasets.apps
	I1028 17:48:27.787148       1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
	I1028 17:48:47.886155       1 client.go:360] parsed scheme: "passthrough"
	I1028 17:48:47.886200       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I1028 17:48:47.886345       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I1028 17:49:31.923523       1 client.go:360] parsed scheme: "passthrough"
	I1028 17:49:31.923617       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I1028 17:49:31.923659       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	
	
	==> kube-controller-manager [07fd4f4cf88e3d8dc2aded1a9598aa51e6c223d50fb52791d54c9b3add751a45] <==
	I1028 17:48:27.865373       1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-client 
	I1028 17:48:27.865725       1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kube-apiserver-client 
	I1028 17:48:27.867001       1 shared_informer.go:247] Caches are synced for certificate-csrsigning-legacy-unknown 
	E1028 17:48:27.875514       1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
	E1028 17:48:27.879712       1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
	I1028 17:48:27.881970       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-97b6q"
	I1028 17:48:27.882013       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-dzxmm"
	I1028 17:48:27.898379       1 shared_informer.go:247] Caches are synced for service account 
	I1028 17:48:27.910512       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-zzhjw"
	I1028 17:48:27.935710       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-bgvdq"
	I1028 17:48:27.950680       1 shared_informer.go:247] Caches are synced for resource quota 
	E1028 17:48:28.009883       1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
	I1028 17:48:28.014018       1 shared_informer.go:247] Caches are synced for HPA 
	I1028 17:48:28.168446       1 shared_informer.go:240] Waiting for caches to sync for garbage collector
	I1028 17:48:28.380988       1 shared_informer.go:247] Caches are synced for garbage collector 
	I1028 17:48:28.397937       1 shared_informer.go:247] Caches are synced for garbage collector 
	I1028 17:48:28.397958       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I1028 17:48:28.597715       1 request.go:655] Throttling request took 1.048071519s, request: GET:https://192.168.76.2:8443/apis/scheduling.k8s.io/v1beta1?timeout=32s
	I1028 17:48:29.400761       1 shared_informer.go:240] Waiting for caches to sync for resource quota
	I1028 17:48:29.400795       1 shared_informer.go:247] Caches are synced for resource quota 
	I1028 17:48:29.582550       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
	I1028 17:48:29.651725       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-bgvdq"
	I1028 17:48:32.702582       1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
	I1028 17:50:06.724159       1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
	E1028 17:50:06.877962       1 clusterroleaggregation_controller.go:181] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
	
	
	==> kube-controller-manager [45d2c62bb3793fa6d89a6c164b4374c47a3f66a974d945765740acb8ccbedcb6] <==
	W1028 17:52:14.964054       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E1028 17:52:41.027833       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I1028 17:52:46.614371       1 request.go:655] Throttling request took 1.048275299s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W1028 17:52:47.465834       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E1028 17:53:11.529839       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I1028 17:53:19.116346       1 request.go:655] Throttling request took 1.048242119s, request: GET:https://192.168.76.2:8443/apis/admissionregistration.k8s.io/v1beta1?timeout=32s
	W1028 17:53:20.008739       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E1028 17:53:42.031925       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I1028 17:53:51.667739       1 request.go:655] Throttling request took 1.04562165s, request: GET:https://192.168.76.2:8443/apis/scheduling.k8s.io/v1?timeout=32s
	W1028 17:53:52.519164       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E1028 17:54:12.534083       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I1028 17:54:24.169637       1 request.go:655] Throttling request took 1.048365924s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W1028 17:54:25.021432       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E1028 17:54:43.035983       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I1028 17:54:56.672043       1 request.go:655] Throttling request took 1.048248281s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W1028 17:54:57.523540       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E1028 17:55:13.538025       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I1028 17:55:29.173913       1 request.go:655] Throttling request took 1.048232162s, request: GET:https://192.168.76.2:8443/apis/batch/v1?timeout=32s
	W1028 17:55:30.026151       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E1028 17:55:44.040333       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I1028 17:56:01.699631       1 request.go:655] Throttling request took 1.036877594s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W1028 17:56:02.551307       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E1028 17:56:14.542422       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I1028 17:56:34.201877       1 request.go:655] Throttling request took 1.048028506s, request: GET:https://192.168.76.2:8443/apis/coordination.k8s.io/v1?timeout=32s
	W1028 17:56:35.055405       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	
	
	==> kube-proxy [251d74de7c72ac448ce2eade1fbfd2803813278b8c45ac412fb36f91a30f089b] <==
	I1028 17:50:53.384233       1 node.go:172] Successfully retrieved node IP: 192.168.76.2
	I1028 17:50:53.384331       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
	W1028 17:50:53.442000       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
	I1028 17:50:53.442288       1 server_others.go:185] Using iptables Proxier.
	I1028 17:50:53.442679       1 server.go:650] Version: v1.20.0
	I1028 17:50:53.453106       1 config.go:315] Starting service config controller
	I1028 17:50:53.453318       1 shared_informer.go:240] Waiting for caches to sync for service config
	I1028 17:50:53.453430       1 config.go:224] Starting endpoint slice config controller
	I1028 17:50:53.453521       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	I1028 17:50:53.553496       1 shared_informer.go:247] Caches are synced for service config 
	I1028 17:50:53.553686       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	
	
	==> kube-proxy [f8257840a24c69fe77133dee32fa0a94a2355d1b8d5e80976b9501b041d4e8c1] <==
	I1028 17:48:29.071518       1 node.go:172] Successfully retrieved node IP: 192.168.76.2
	I1028 17:48:29.071597       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
	W1028 17:48:29.096921       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
	I1028 17:48:29.097038       1 server_others.go:185] Using iptables Proxier.
	I1028 17:48:29.097283       1 server.go:650] Version: v1.20.0
	I1028 17:48:29.100713       1 config.go:315] Starting service config controller
	I1028 17:48:29.100725       1 shared_informer.go:240] Waiting for caches to sync for service config
	I1028 17:48:29.100746       1 config.go:224] Starting endpoint slice config controller
	I1028 17:48:29.100750       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	I1028 17:48:29.200880       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	I1028 17:48:29.200948       1 shared_informer.go:247] Caches are synced for service config 
	
	
	==> kube-scheduler [0f6d7fac26d934dce38f183307147896200c44885782c7111659acfe936895ca] <==
	I1028 17:50:42.289320       1 serving.go:331] Generated self-signed cert in-memory
	W1028 17:50:48.757388       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W1028 17:50:48.757429       1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W1028 17:50:48.757442       1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
	W1028 17:50:48.757447       1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I1028 17:50:49.057604       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
	I1028 17:50:49.070734       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I1028 17:50:49.070779       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I1028 17:50:49.070800       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	I1028 17:50:49.271694       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	
	==> kube-scheduler [e659d3edb50edb51ab6db59744e6335c9d2964e447e8376879aafa92499e8d98] <==
	W1028 17:48:09.178863       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W1028 17:48:09.178897       1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W1028 17:48:09.178908       1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
	W1028 17:48:09.178914       1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I1028 17:48:09.289982       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
	I1028 17:48:09.290004       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I1028 17:48:09.290771       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I1028 17:48:09.290197       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	E1028 17:48:09.304875       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E1028 17:48:09.305398       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E1028 17:48:09.305625       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E1028 17:48:09.305836       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E1028 17:48:09.306045       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E1028 17:48:09.306271       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E1028 17:48:09.306475       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E1028 17:48:09.306686       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E1028 17:48:09.306889       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E1028 17:48:09.307064       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E1028 17:48:09.307254       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E1028 17:48:09.307448       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E1028 17:48:10.173176       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E1028 17:48:10.229458       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E1028 17:48:10.254472       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E1028 17:48:10.324655       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	I1028 17:48:12.390943       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	
	==> kubelet <==
	Oct 28 17:54:54 old-k8s-version-743648 kubelet[666]: E1028 17:54:54.140745     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Oct 28 17:55:05 old-k8s-version-743648 kubelet[666]: I1028 17:55:05.137332     666 scope.go:95] [topologymanager] RemoveContainer - Container ID: 97a314c29d1a7bf3d28628be00c27d765855c61ba2697a31be56b8830b3fbf2f
	Oct 28 17:55:05 old-k8s-version-743648 kubelet[666]: E1028 17:55:05.137675     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	Oct 28 17:55:06 old-k8s-version-743648 kubelet[666]: E1028 17:55:06.141555     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Oct 28 17:55:18 old-k8s-version-743648 kubelet[666]: I1028 17:55:18.141555     666 scope.go:95] [topologymanager] RemoveContainer - Container ID: 97a314c29d1a7bf3d28628be00c27d765855c61ba2697a31be56b8830b3fbf2f
	Oct 28 17:55:18 old-k8s-version-743648 kubelet[666]: E1028 17:55:18.142304     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	Oct 28 17:55:18 old-k8s-version-743648 kubelet[666]: E1028 17:55:18.144881     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Oct 28 17:55:30 old-k8s-version-743648 kubelet[666]: E1028 17:55:30.145457     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Oct 28 17:55:30 old-k8s-version-743648 kubelet[666]: I1028 17:55:30.147543     666 scope.go:95] [topologymanager] RemoveContainer - Container ID: 97a314c29d1a7bf3d28628be00c27d765855c61ba2697a31be56b8830b3fbf2f
	Oct 28 17:55:30 old-k8s-version-743648 kubelet[666]: E1028 17:55:30.148252     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: I1028 17:55:45.142270     666 scope.go:95] [topologymanager] RemoveContainer - Container ID: 97a314c29d1a7bf3d28628be00c27d765855c61ba2697a31be56b8830b3fbf2f
	Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.143236     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	Oct 28 17:55:45 old-k8s-version-743648 kubelet[666]: E1028 17:55:45.149385     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Oct 28 17:55:56 old-k8s-version-743648 kubelet[666]: I1028 17:55:56.137715     666 scope.go:95] [topologymanager] RemoveContainer - Container ID: 97a314c29d1a7bf3d28628be00c27d765855c61ba2697a31be56b8830b3fbf2f
	Oct 28 17:55:56 old-k8s-version-743648 kubelet[666]: E1028 17:55:56.138548     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	Oct 28 17:55:59 old-k8s-version-743648 kubelet[666]: E1028 17:55:59.138036     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Oct 28 17:56:11 old-k8s-version-743648 kubelet[666]: I1028 17:56:11.139857     666 scope.go:95] [topologymanager] RemoveContainer - Container ID: 97a314c29d1a7bf3d28628be00c27d765855c61ba2697a31be56b8830b3fbf2f
	Oct 28 17:56:11 old-k8s-version-743648 kubelet[666]: E1028 17:56:11.140245     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	Oct 28 17:56:13 old-k8s-version-743648 kubelet[666]: E1028 17:56:13.138081     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Oct 28 17:56:22 old-k8s-version-743648 kubelet[666]: I1028 17:56:22.137678     666 scope.go:95] [topologymanager] RemoveContainer - Container ID: 97a314c29d1a7bf3d28628be00c27d765855c61ba2697a31be56b8830b3fbf2f
	Oct 28 17:56:22 old-k8s-version-743648 kubelet[666]: E1028 17:56:22.139322     666 pod_workers.go:191] Error syncing pod 712fa420-47ed-4b4c-9393-81f7de5567ce ("dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jx67q_kubernetes-dashboard(712fa420-47ed-4b4c-9393-81f7de5567ce)"
	Oct 28 17:56:25 old-k8s-version-743648 kubelet[666]: E1028 17:56:25.158224     666 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
	Oct 28 17:56:25 old-k8s-version-743648 kubelet[666]: E1028 17:56:25.158282     666 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
	Oct 28 17:56:25 old-k8s-version-743648 kubelet[666]: E1028 17:56:25.158425     666 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>}  BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-s8546,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-4qgm8_kube-system(7233889
6-039d-4572-89ae-d308c555fbbf): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
	Oct 28 17:56:25 old-k8s-version-743648 kubelet[666]: E1028 17:56:25.158461     666 pod_workers.go:191] Error syncing pod 72338896-039d-4572-89ae-d308c555fbbf ("metrics-server-9975d5f86-4qgm8_kube-system(72338896-039d-4572-89ae-d308c555fbbf)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	
	
	==> kubernetes-dashboard [616276ec12d451a51fff6336da444384ed153fbabadc71092e8a7c724398c245] <==
	2024/10/28 17:51:14 Using namespace: kubernetes-dashboard
	2024/10/28 17:51:14 Using in-cluster config to connect to apiserver
	2024/10/28 17:51:14 Using secret token for csrf signing
	2024/10/28 17:51:14 Initializing csrf token from kubernetes-dashboard-csrf secret
	2024/10/28 17:51:14 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
	2024/10/28 17:51:14 Successful initial request to the apiserver, version: v1.20.0
	2024/10/28 17:51:14 Generating JWE encryption key
	2024/10/28 17:51:14 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
	2024/10/28 17:51:14 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
	2024/10/28 17:51:15 Initializing JWE encryption key from synchronized object
	2024/10/28 17:51:15 Creating in-cluster Sidecar client
	2024/10/28 17:51:15 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/10/28 17:51:15 Serving insecurely on HTTP port: 9090
	2024/10/28 17:51:45 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/10/28 17:52:15 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/10/28 17:52:45 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/10/28 17:53:15 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/10/28 17:53:45 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/10/28 17:54:15 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/10/28 17:54:45 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/10/28 17:55:15 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/10/28 17:55:45 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/10/28 17:56:15 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/10/28 17:51:14 Starting overwatch
	
	
	==> storage-provisioner [1aef6c7a010641c3e8bf5bbb6a6f0f188a15cc0faf087e71c2fdba8fe931c220] <==
	I1028 17:51:36.360428       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I1028 17:51:36.392696       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I1028 17:51:36.392857       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I1028 17:51:53.872083       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I1028 17:51:53.872444       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-743648_125f5f55-0654-4195-8e5a-fd25c19c4bc9!
	I1028 17:51:53.873958       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"5d49336d-1a77-47b8-a8ce-ce674c284004", APIVersion:"v1", ResourceVersion:"852", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-743648_125f5f55-0654-4195-8e5a-fd25c19c4bc9 became leader
	I1028 17:51:53.972796       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-743648_125f5f55-0654-4195-8e5a-fd25c19c4bc9!
	
	
	==> storage-provisioner [7dafca81669967e40246c9d3a7d8737952b84284dae042835a4a590f12a77f78] <==
	I1028 17:50:52.559464       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	F1028 17:51:22.561690       1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-743648 -n old-k8s-version-743648
helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-743648 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-4qgm8
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context old-k8s-version-743648 describe pod metrics-server-9975d5f86-4qgm8
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-743648 describe pod metrics-server-9975d5f86-4qgm8: exit status 1 (130.707545ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "metrics-server-9975d5f86-4qgm8" not found

                                                
                                                
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-743648 describe pod metrics-server-9975d5f86-4qgm8: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (377.31s)

                                                
                                    

Test pass (300/330)

Order passed test Duration
3 TestDownloadOnly/v1.20.0/json-events 15.82
4 TestDownloadOnly/v1.20.0/preload-exists 0
8 TestDownloadOnly/v1.20.0/LogsDuration 0.08
9 TestDownloadOnly/v1.20.0/DeleteAll 0.21
10 TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds 0.13
12 TestDownloadOnly/v1.31.2/json-events 7.4
13 TestDownloadOnly/v1.31.2/preload-exists 0
17 TestDownloadOnly/v1.31.2/LogsDuration 0.08
18 TestDownloadOnly/v1.31.2/DeleteAll 0.21
19 TestDownloadOnly/v1.31.2/DeleteAlwaysSucceeds 0.14
21 TestBinaryMirror 0.57
25 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.07
26 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.08
27 TestAddons/Setup 264.41
29 TestAddons/serial/Volcano 39.82
31 TestAddons/serial/GCPAuth/Namespaces 0.19
32 TestAddons/serial/GCPAuth/FakeCredentials 10.92
35 TestAddons/parallel/Registry 17.5
36 TestAddons/parallel/Ingress 19.51
37 TestAddons/parallel/InspektorGadget 10.75
38 TestAddons/parallel/MetricsServer 6.94
40 TestAddons/parallel/CSI 45.66
41 TestAddons/parallel/Headlamp 17
42 TestAddons/parallel/CloudSpanner 6.72
43 TestAddons/parallel/LocalPath 54.15
44 TestAddons/parallel/NvidiaDevicePlugin 5.85
45 TestAddons/parallel/Yakd 11.8
47 TestAddons/StoppedEnableDisable 12.77
48 TestCertOptions 38.41
49 TestCertExpiration 228.68
51 TestForceSystemdFlag 41.58
52 TestForceSystemdEnv 38.86
53 TestDockerEnvContainerd 44.62
58 TestErrorSpam/setup 30.12
59 TestErrorSpam/start 0.71
60 TestErrorSpam/status 1.06
61 TestErrorSpam/pause 1.79
62 TestErrorSpam/unpause 1.88
63 TestErrorSpam/stop 1.48
66 TestFunctional/serial/CopySyncFile 0
67 TestFunctional/serial/StartWithProxy 92.43
68 TestFunctional/serial/AuditLog 0
69 TestFunctional/serial/SoftStart 6.88
70 TestFunctional/serial/KubeContext 0.07
71 TestFunctional/serial/KubectlGetPods 0.12
74 TestFunctional/serial/CacheCmd/cache/add_remote 4.29
75 TestFunctional/serial/CacheCmd/cache/add_local 1.18
76 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.06
77 TestFunctional/serial/CacheCmd/cache/list 0.06
78 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.31
79 TestFunctional/serial/CacheCmd/cache/cache_reload 2.04
80 TestFunctional/serial/CacheCmd/cache/delete 0.12
81 TestFunctional/serial/MinikubeKubectlCmd 0.14
82 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.14
83 TestFunctional/serial/ExtraConfig 46.68
84 TestFunctional/serial/ComponentHealth 0.1
85 TestFunctional/serial/LogsCmd 1.7
86 TestFunctional/serial/LogsFileCmd 1.66
87 TestFunctional/serial/InvalidService 4.12
89 TestFunctional/parallel/ConfigCmd 0.53
90 TestFunctional/parallel/DashboardCmd 7.16
91 TestFunctional/parallel/DryRun 0.42
92 TestFunctional/parallel/InternationalLanguage 0.25
93 TestFunctional/parallel/StatusCmd 1.3
97 TestFunctional/parallel/ServiceCmdConnect 11.7
98 TestFunctional/parallel/AddonsCmd 0.2
99 TestFunctional/parallel/PersistentVolumeClaim 27.1
101 TestFunctional/parallel/SSHCmd 0.65
102 TestFunctional/parallel/CpCmd 2.36
104 TestFunctional/parallel/FileSync 0.36
105 TestFunctional/parallel/CertSync 2.48
109 TestFunctional/parallel/NodeLabels 0.14
111 TestFunctional/parallel/NonActiveRuntimeDisabled 0.7
113 TestFunctional/parallel/License 0.29
115 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.67
116 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
118 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 8.46
119 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.11
120 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
124 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
125 TestFunctional/parallel/ServiceCmd/DeployApp 7.26
126 TestFunctional/parallel/ProfileCmd/profile_not_create 0.5
127 TestFunctional/parallel/ServiceCmd/List 0.58
128 TestFunctional/parallel/ProfileCmd/profile_list 0.56
129 TestFunctional/parallel/ServiceCmd/JSONOutput 0.61
130 TestFunctional/parallel/ProfileCmd/profile_json_output 0.48
131 TestFunctional/parallel/ServiceCmd/HTTPS 0.63
132 TestFunctional/parallel/MountCmd/any-port 9.77
133 TestFunctional/parallel/ServiceCmd/Format 0.43
134 TestFunctional/parallel/ServiceCmd/URL 0.45
135 TestFunctional/parallel/MountCmd/specific-port 2.11
136 TestFunctional/parallel/Version/short 0.07
137 TestFunctional/parallel/Version/components 1.33
138 TestFunctional/parallel/ImageCommands/ImageListShort 0.3
139 TestFunctional/parallel/ImageCommands/ImageListTable 0.3
140 TestFunctional/parallel/ImageCommands/ImageListJson 0.3
141 TestFunctional/parallel/ImageCommands/ImageListYaml 0.29
142 TestFunctional/parallel/ImageCommands/ImageBuild 4.06
143 TestFunctional/parallel/ImageCommands/Setup 0.89
144 TestFunctional/parallel/MountCmd/VerifyCleanup 2.13
145 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 1.6
146 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 1.7
147 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 1.77
148 TestFunctional/parallel/UpdateContextCmd/no_changes 0.2
149 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.21
150 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.22
151 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.42
152 TestFunctional/parallel/ImageCommands/ImageRemove 0.58
153 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.83
154 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.4
155 TestFunctional/delete_echo-server_images 0.04
156 TestFunctional/delete_my-image_image 0.02
157 TestFunctional/delete_minikube_cached_images 0.02
161 TestMultiControlPlane/serial/StartCluster 133.45
162 TestMultiControlPlane/serial/DeployApp 35.97
163 TestMultiControlPlane/serial/PingHostFromPods 1.68
164 TestMultiControlPlane/serial/AddWorkerNode 22.6
165 TestMultiControlPlane/serial/NodeLabels 0.12
166 TestMultiControlPlane/serial/HAppyAfterClusterStart 1.03
167 TestMultiControlPlane/serial/CopyFile 19.67
168 TestMultiControlPlane/serial/StopSecondaryNode 12.9
169 TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop 0.81
170 TestMultiControlPlane/serial/RestartSecondaryNode 19.81
171 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart 1
172 TestMultiControlPlane/serial/RestartClusterKeepsNodes 139.56
173 TestMultiControlPlane/serial/DeleteSecondaryNode 11.19
174 TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete 0.76
175 TestMultiControlPlane/serial/StopCluster 36.18
176 TestMultiControlPlane/serial/RestartCluster 77.93
177 TestMultiControlPlane/serial/DegradedAfterClusterRestart 0.78
178 TestMultiControlPlane/serial/AddSecondaryNode 42.76
179 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd 1.11
183 TestJSONOutput/start/Command 90.99
184 TestJSONOutput/start/Audit 0
186 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
187 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
189 TestJSONOutput/pause/Command 0.75
190 TestJSONOutput/pause/Audit 0
192 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
193 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
195 TestJSONOutput/unpause/Command 0.68
196 TestJSONOutput/unpause/Audit 0
198 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
199 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
201 TestJSONOutput/stop/Command 5.82
202 TestJSONOutput/stop/Audit 0
204 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
205 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
206 TestErrorJSONOutput 0.24
208 TestKicCustomNetwork/create_custom_network 38.7
209 TestKicCustomNetwork/use_default_bridge_network 31.28
210 TestKicExistingNetwork 31.15
211 TestKicCustomSubnet 36.8
212 TestKicStaticIP 34.51
213 TestMainNoArgs 0.06
214 TestMinikubeProfile 65.85
217 TestMountStart/serial/StartWithMountFirst 6.8
218 TestMountStart/serial/VerifyMountFirst 0.28
219 TestMountStart/serial/StartWithMountSecond 5.93
220 TestMountStart/serial/VerifyMountSecond 0.26
221 TestMountStart/serial/DeleteFirst 1.6
222 TestMountStart/serial/VerifyMountPostDelete 0.26
223 TestMountStart/serial/Stop 1.2
224 TestMountStart/serial/RestartStopped 8.22
225 TestMountStart/serial/VerifyMountPostStop 0.28
228 TestMultiNode/serial/FreshStart2Nodes 66.75
229 TestMultiNode/serial/DeployApp2Nodes 16.48
230 TestMultiNode/serial/PingHostFrom2Pods 1.03
231 TestMultiNode/serial/AddNode 17.32
232 TestMultiNode/serial/MultiNodeLabels 0.09
233 TestMultiNode/serial/ProfileList 0.69
234 TestMultiNode/serial/CopyFile 10.47
235 TestMultiNode/serial/StopNode 2.33
236 TestMultiNode/serial/StartAfterStop 9.45
237 TestMultiNode/serial/RestartKeepsNodes 92.56
238 TestMultiNode/serial/DeleteNode 5.62
239 TestMultiNode/serial/StopMultiNode 24.05
240 TestMultiNode/serial/RestartMultiNode 60.33
241 TestMultiNode/serial/ValidateNameConflict 36.03
246 TestPreload 125.53
248 TestScheduledStopUnix 107.51
251 TestInsufficientStorage 10.53
252 TestRunningBinaryUpgrade 85.5
254 TestKubernetesUpgrade 355.18
255 TestMissingContainerUpgrade 177.89
257 TestNoKubernetes/serial/StartNoK8sWithVersion 0.1
258 TestNoKubernetes/serial/StartWithK8s 39.32
259 TestNoKubernetes/serial/StartWithStopK8s 17.8
260 TestNoKubernetes/serial/Start 9.08
261 TestNoKubernetes/serial/VerifyK8sNotRunning 0.31
262 TestNoKubernetes/serial/ProfileList 1.25
263 TestNoKubernetes/serial/Stop 1.26
264 TestNoKubernetes/serial/StartNoArgs 6.87
265 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.27
266 TestStoppedBinaryUpgrade/Setup 0.99
267 TestStoppedBinaryUpgrade/Upgrade 87.53
268 TestStoppedBinaryUpgrade/MinikubeLogs 1.69
277 TestPause/serial/Start 55.11
278 TestPause/serial/SecondStartNoReconfiguration 7.81
279 TestPause/serial/Pause 1.08
280 TestPause/serial/VerifyStatus 0.5
281 TestPause/serial/Unpause 1.03
282 TestPause/serial/PauseAgain 1.28
283 TestPause/serial/DeletePaused 3.26
284 TestPause/serial/VerifyDeletedResources 0.52
292 TestNetworkPlugins/group/false 5.07
297 TestStartStop/group/old-k8s-version/serial/FirstStart 151.8
298 TestStartStop/group/old-k8s-version/serial/DeployApp 9.61
299 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 1.72
300 TestStartStop/group/old-k8s-version/serial/Stop 12.43
302 TestStartStop/group/no-preload/serial/FirstStart 78.48
303 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.23
305 TestStartStop/group/no-preload/serial/DeployApp 10.34
306 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 1.14
307 TestStartStop/group/no-preload/serial/Stop 12.21
308 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.19
309 TestStartStop/group/no-preload/serial/SecondStart 266.67
310 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 6
311 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.13
312 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.31
313 TestStartStop/group/no-preload/serial/Pause 3.61
314 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 6.01
316 TestStartStop/group/embed-certs/serial/FirstStart 90.07
317 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.2
318 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.64
319 TestStartStop/group/old-k8s-version/serial/Pause 3.25
321 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 59.55
322 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 9.37
323 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 1.19
324 TestStartStop/group/default-k8s-diff-port/serial/Stop 12.11
325 TestStartStop/group/embed-certs/serial/DeployApp 9.32
326 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.21
327 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 289.68
328 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 1.58
329 TestStartStop/group/embed-certs/serial/Stop 12.28
330 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.22
331 TestStartStop/group/embed-certs/serial/SecondStart 268.6
332 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 6.01
333 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 6.01
334 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.12
335 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 5.15
336 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.25
337 TestStartStop/group/embed-certs/serial/Pause 3.09
338 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.37
339 TestStartStop/group/default-k8s-diff-port/serial/Pause 4.31
341 TestStartStop/group/newest-cni/serial/FirstStart 45.01
342 TestNetworkPlugins/group/auto/Start 85.59
343 TestStartStop/group/newest-cni/serial/DeployApp 0
344 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 1.52
345 TestStartStop/group/newest-cni/serial/Stop 1.36
346 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.33
347 TestStartStop/group/newest-cni/serial/SecondStart 16.58
348 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
349 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
350 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.34
351 TestStartStop/group/newest-cni/serial/Pause 3.31
352 TestNetworkPlugins/group/kindnet/Start 81.98
353 TestNetworkPlugins/group/auto/KubeletFlags 0.39
354 TestNetworkPlugins/group/auto/NetCatPod 11.38
355 TestNetworkPlugins/group/auto/DNS 0.27
356 TestNetworkPlugins/group/auto/Localhost 0.28
357 TestNetworkPlugins/group/auto/HairPin 0.16
358 TestNetworkPlugins/group/calico/Start 67.96
359 TestNetworkPlugins/group/kindnet/ControllerPod 6.01
360 TestNetworkPlugins/group/kindnet/KubeletFlags 0.48
361 TestNetworkPlugins/group/kindnet/NetCatPod 11.39
362 TestNetworkPlugins/group/kindnet/DNS 0.27
363 TestNetworkPlugins/group/kindnet/Localhost 0.19
364 TestNetworkPlugins/group/kindnet/HairPin 0.27
365 TestNetworkPlugins/group/calico/ControllerPod 6.01
366 TestNetworkPlugins/group/custom-flannel/Start 56.94
367 TestNetworkPlugins/group/calico/KubeletFlags 0.32
368 TestNetworkPlugins/group/calico/NetCatPod 11.32
369 TestNetworkPlugins/group/calico/DNS 0.27
370 TestNetworkPlugins/group/calico/Localhost 0.22
371 TestNetworkPlugins/group/calico/HairPin 0.23
372 TestNetworkPlugins/group/enable-default-cni/Start 71.79
373 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.4
374 TestNetworkPlugins/group/custom-flannel/NetCatPod 10.34
375 TestNetworkPlugins/group/custom-flannel/DNS 0.38
376 TestNetworkPlugins/group/custom-flannel/Localhost 0.24
377 TestNetworkPlugins/group/custom-flannel/HairPin 0.2
378 TestNetworkPlugins/group/flannel/Start 54.72
379 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.43
380 TestNetworkPlugins/group/enable-default-cni/NetCatPod 11.47
381 TestNetworkPlugins/group/enable-default-cni/DNS 0.19
382 TestNetworkPlugins/group/enable-default-cni/Localhost 0.21
383 TestNetworkPlugins/group/enable-default-cni/HairPin 0.15
384 TestNetworkPlugins/group/flannel/ControllerPod 6.01
385 TestNetworkPlugins/group/bridge/Start 83.51
386 TestNetworkPlugins/group/flannel/KubeletFlags 0.38
387 TestNetworkPlugins/group/flannel/NetCatPod 11.38
388 TestNetworkPlugins/group/flannel/DNS 0.24
389 TestNetworkPlugins/group/flannel/Localhost 0.2
390 TestNetworkPlugins/group/flannel/HairPin 0.2
391 TestNetworkPlugins/group/bridge/KubeletFlags 0.31
392 TestNetworkPlugins/group/bridge/NetCatPod 10.28
393 TestNetworkPlugins/group/bridge/DNS 0.18
394 TestNetworkPlugins/group/bridge/Localhost 0.18
395 TestNetworkPlugins/group/bridge/HairPin 0.16
x
+
TestDownloadOnly/v1.20.0/json-events (15.82s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-057560 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-057560 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (15.824585799s)
--- PASS: TestDownloadOnly/v1.20.0/json-events (15.82s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/preload-exists
I1028 17:00:26.945077    7866 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I1028 17:00:26.945159    7866 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19872-2421/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
--- PASS: TestDownloadOnly/v1.20.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-057560
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-057560: exit status 85 (75.786637ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-057560 | jenkins | v1.34.0 | 28 Oct 24 17:00 UTC |          |
	|         | -p download-only-057560        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	
	==> Last Start <==
	Log file created at: 2024/10/28 17:00:11
	Running on machine: ip-172-31-24-2
	Binary: Built with gc go1.23.2 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1028 17:00:11.170193    7871 out.go:345] Setting OutFile to fd 1 ...
	I1028 17:00:11.170401    7871 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:00:11.170429    7871 out.go:358] Setting ErrFile to fd 2...
	I1028 17:00:11.170450    7871 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:00:11.170710    7871 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
	W1028 17:00:11.170872    7871 root.go:314] Error reading config file at /home/jenkins/minikube-integration/19872-2421/.minikube/config/config.json: open /home/jenkins/minikube-integration/19872-2421/.minikube/config/config.json: no such file or directory
	I1028 17:00:11.171319    7871 out.go:352] Setting JSON to true
	I1028 17:00:11.172109    7871 start.go:129] hostinfo: {"hostname":"ip-172-31-24-2","uptime":2558,"bootTime":1730132254,"procs":148,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"6d436adf-771e-4269-b9a3-c25fd4fca4f5"}
	I1028 17:00:11.172203    7871 start.go:139] virtualization:  
	I1028 17:00:11.175479    7871 out.go:97] [download-only-057560] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	W1028 17:00:11.175635    7871 preload.go:293] Failed to list preload files: open /home/jenkins/minikube-integration/19872-2421/.minikube/cache/preloaded-tarball: no such file or directory
	I1028 17:00:11.175756    7871 notify.go:220] Checking for updates...
	I1028 17:00:11.178287    7871 out.go:169] MINIKUBE_LOCATION=19872
	I1028 17:00:11.180763    7871 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 17:00:11.183048    7871 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig
	I1028 17:00:11.185391    7871 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube
	I1028 17:00:11.188056    7871 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W1028 17:00:11.193825    7871 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I1028 17:00:11.194097    7871 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 17:00:11.222639    7871 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
	I1028 17:00:11.222753    7871 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1028 17:00:11.623570    7871 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:52 SystemTime:2024-10-28 17:00:11.613937965 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I1028 17:00:11.623678    7871 docker.go:318] overlay module found
	I1028 17:00:11.626475    7871 out.go:97] Using the docker driver based on user configuration
	I1028 17:00:11.626505    7871 start.go:297] selected driver: docker
	I1028 17:00:11.626512    7871 start.go:901] validating driver "docker" against <nil>
	I1028 17:00:11.626617    7871 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1028 17:00:11.683665    7871 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:52 SystemTime:2024-10-28 17:00:11.674626509 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I1028 17:00:11.683865    7871 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 17:00:11.684168    7871 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I1028 17:00:11.684345    7871 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I1028 17:00:11.686553    7871 out.go:169] Using Docker driver with root privileges
	I1028 17:00:11.688461    7871 cni.go:84] Creating CNI manager for ""
	I1028 17:00:11.688530    7871 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I1028 17:00:11.688576    7871 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I1028 17:00:11.688668    7871 start.go:340] cluster config:
	{Name:download-only-057560 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-057560 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 17:00:11.690850    7871 out.go:97] Starting "download-only-057560" primary control-plane node in "download-only-057560" cluster
	I1028 17:00:11.690881    7871 cache.go:121] Beginning downloading kic base image for docker with containerd
	I1028 17:00:11.693577    7871 out.go:97] Pulling base image v0.0.45-1730110049-19872 ...
	I1028 17:00:11.693612    7871 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I1028 17:00:11.693767    7871 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 in local docker daemon
	I1028 17:00:11.708721    7871 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 to local cache
	I1028 17:00:11.708910    7871 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 in local cache directory
	I1028 17:00:11.709015    7871 image.go:148] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 to local cache
	I1028 17:00:11.815399    7871 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
	I1028 17:00:11.815425    7871 cache.go:56] Caching tarball of preloaded images
	I1028 17:00:11.815596    7871 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I1028 17:00:11.818326    7871 out.go:97] Downloading Kubernetes v1.20.0 preload ...
	I1028 17:00:11.818348    7871 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 ...
	I1028 17:00:11.903431    7871 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4?checksum=md5:7e3d48ccb9f143791669d02e14ce1643 -> /home/jenkins/minikube-integration/19872-2421/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
	I1028 17:00:19.120671    7871 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 as a tarball
	I1028 17:00:25.320597    7871 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 ...
	I1028 17:00:25.320723    7871 preload.go:254] verifying checksum of /home/jenkins/minikube-integration/19872-2421/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 ...
	
	
	* The control-plane node download-only-057560 host does not exist
	  To start a cluster, run: "minikube start -p download-only-057560"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.20.0/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAll (0.21s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.20.0/DeleteAll (0.21s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-057560
--- PASS: TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/json-events (7.4s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-772403 --force --alsologtostderr --kubernetes-version=v1.31.2 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-772403 --force --alsologtostderr --kubernetes-version=v1.31.2 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (7.402178076s)
--- PASS: TestDownloadOnly/v1.31.2/json-events (7.40s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/preload-exists
I1028 17:00:34.758285    7866 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime containerd
I1028 17:00:34.758327    7866 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19872-2421/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4
--- PASS: TestDownloadOnly/v1.31.2/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-772403
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-772403: exit status 85 (83.208458ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-057560 | jenkins | v1.34.0 | 28 Oct 24 17:00 UTC |                     |
	|         | -p download-only-057560        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	| delete  | --all                          | minikube             | jenkins | v1.34.0 | 28 Oct 24 17:00 UTC | 28 Oct 24 17:00 UTC |
	| delete  | -p download-only-057560        | download-only-057560 | jenkins | v1.34.0 | 28 Oct 24 17:00 UTC | 28 Oct 24 17:00 UTC |
	| start   | -o=json --download-only        | download-only-772403 | jenkins | v1.34.0 | 28 Oct 24 17:00 UTC |                     |
	|         | -p download-only-772403        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.2   |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/10/28 17:00:27
	Running on machine: ip-172-31-24-2
	Binary: Built with gc go1.23.2 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I1028 17:00:27.402427    8070 out.go:345] Setting OutFile to fd 1 ...
	I1028 17:00:27.402900    8070 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:00:27.402941    8070 out.go:358] Setting ErrFile to fd 2...
	I1028 17:00:27.402963    8070 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:00:27.403247    8070 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
	I1028 17:00:27.403664    8070 out.go:352] Setting JSON to true
	I1028 17:00:27.404437    8070 start.go:129] hostinfo: {"hostname":"ip-172-31-24-2","uptime":2574,"bootTime":1730132254,"procs":146,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"6d436adf-771e-4269-b9a3-c25fd4fca4f5"}
	I1028 17:00:27.404533    8070 start.go:139] virtualization:  
	I1028 17:00:27.407928    8070 out.go:97] [download-only-772403] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	I1028 17:00:27.408117    8070 notify.go:220] Checking for updates...
	I1028 17:00:27.410595    8070 out.go:169] MINIKUBE_LOCATION=19872
	I1028 17:00:27.413099    8070 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 17:00:27.415256    8070 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig
	I1028 17:00:27.417696    8070 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube
	I1028 17:00:27.420353    8070 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W1028 17:00:27.424783    8070 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I1028 17:00:27.425062    8070 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 17:00:27.446493    8070 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
	I1028 17:00:27.446596    8070 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1028 17:00:27.509802    8070 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-10-28 17:00:27.497520683 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I1028 17:00:27.509916    8070 docker.go:318] overlay module found
	I1028 17:00:27.512408    8070 out.go:97] Using the docker driver based on user configuration
	I1028 17:00:27.512437    8070 start.go:297] selected driver: docker
	I1028 17:00:27.512445    8070 start.go:901] validating driver "docker" against <nil>
	I1028 17:00:27.512556    8070 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1028 17:00:27.560509    8070 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-10-28 17:00:27.551596196 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I1028 17:00:27.560735    8070 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I1028 17:00:27.561020    8070 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I1028 17:00:27.561176    8070 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I1028 17:00:27.563666    8070 out.go:169] Using Docker driver with root privileges
	I1028 17:00:27.565796    8070 cni.go:84] Creating CNI manager for ""
	I1028 17:00:27.565860    8070 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I1028 17:00:27.565875    8070 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I1028 17:00:27.565958    8070 start.go:340] cluster config:
	{Name:download-only-772403 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:download-only-772403 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 17:00:27.568204    8070 out.go:97] Starting "download-only-772403" primary control-plane node in "download-only-772403" cluster
	I1028 17:00:27.568228    8070 cache.go:121] Beginning downloading kic base image for docker with containerd
	I1028 17:00:27.570340    8070 out.go:97] Pulling base image v0.0.45-1730110049-19872 ...
	I1028 17:00:27.570367    8070 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime containerd
	I1028 17:00:27.570523    8070 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 in local docker daemon
	I1028 17:00:27.585084    8070 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 to local cache
	I1028 17:00:27.585208    8070 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 in local cache directory
	I1028 17:00:27.585231    8070 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 in local cache directory, skipping pull
	I1028 17:00:27.585237    8070 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 exists in cache, skipping pull
	I1028 17:00:27.585244    8070 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 as a tarball
	I1028 17:00:27.638103    8070 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.2/preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4
	I1028 17:00:27.638131    8070 cache.go:56] Caching tarball of preloaded images
	I1028 17:00:27.638340    8070 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime containerd
	I1028 17:00:27.641381    8070 out.go:97] Downloading Kubernetes v1.31.2 preload ...
	I1028 17:00:27.641413    8070 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4 ...
	I1028 17:00:27.747629    8070 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.2/preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4?checksum=md5:5a1c96cd03f848c5b0e8fb66f315acd5 -> /home/jenkins/minikube-integration/19872-2421/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-containerd-overlay2-arm64.tar.lz4
	
	
	* The control-plane node download-only-772403 host does not exist
	  To start a cluster, run: "minikube start -p download-only-772403"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.31.2/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/DeleteAll (0.21s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.31.2/DeleteAll (0.21s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/DeleteAlwaysSucceeds (0.14s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-772403
--- PASS: TestDownloadOnly/v1.31.2/DeleteAlwaysSucceeds (0.14s)

                                                
                                    
x
+
TestBinaryMirror (0.57s)

                                                
                                                
=== RUN   TestBinaryMirror
I1028 17:00:35.994877    7866 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/arm64/kubectl.sha256
aaa_download_only_test.go:314: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-523126 --alsologtostderr --binary-mirror http://127.0.0.1:36805 --driver=docker  --container-runtime=containerd
helpers_test.go:175: Cleaning up "binary-mirror-523126" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-523126
--- PASS: TestBinaryMirror (0.57s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.07s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:939: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-896964
addons_test.go:939: (dbg) Non-zero exit: out/minikube-linux-arm64 addons enable dashboard -p addons-896964: exit status 85 (74.72476ms)

                                                
                                                
-- stdout --
	* Profile "addons-896964" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-896964"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.07s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.08s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:950: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-896964
addons_test.go:950: (dbg) Non-zero exit: out/minikube-linux-arm64 addons disable dashboard -p addons-896964: exit status 85 (77.769661ms)

                                                
                                                
-- stdout --
	* Profile "addons-896964" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-896964"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.08s)

                                                
                                    
x
+
TestAddons/Setup (264.41s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:107: (dbg) Run:  out/minikube-linux-arm64 start -p addons-896964 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher
addons_test.go:107: (dbg) Done: out/minikube-linux-arm64 start -p addons-896964 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher: (4m24.406500733s)
--- PASS: TestAddons/Setup (264.41s)

                                                
                                    
x
+
TestAddons/serial/Volcano (39.82s)

                                                
                                                
=== RUN   TestAddons/serial/Volcano
addons_test.go:807: volcano-scheduler stabilized in 63.046669ms
addons_test.go:815: volcano-admission stabilized in 63.339719ms
addons_test.go:823: volcano-controller stabilized in 63.677782ms
addons_test.go:829: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-6c9778cbdf-prmpv" [e8aae1e1-8645-433b-9067-8710f89d6f4b] Running
addons_test.go:829: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.007246121s
addons_test.go:833: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-5874dfdd79-5r7d6" [3849fcca-05ec-4a29-ba4c-01767461ce68] Running
addons_test.go:833: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.003426603s
addons_test.go:837: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-789ffc5785-n6shq" [08c0f79f-fa21-4b93-9c4a-d0f0772ef43f] Running
addons_test.go:837: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.00461331s
addons_test.go:842: (dbg) Run:  kubectl --context addons-896964 delete -n volcano-system job volcano-admission-init
addons_test.go:848: (dbg) Run:  kubectl --context addons-896964 create -f testdata/vcjob.yaml
addons_test.go:856: (dbg) Run:  kubectl --context addons-896964 get vcjob -n my-volcano
addons_test.go:874: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [a82bf204-346d-4ab1-9b19-dee9c26d05e4] Pending
helpers_test.go:344: "test-job-nginx-0" [a82bf204-346d-4ab1-9b19-dee9c26d05e4] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "test-job-nginx-0" [a82bf204-346d-4ab1-9b19-dee9c26d05e4] Running
addons_test.go:874: (dbg) TestAddons/serial/Volcano: volcano.sh/job-name=test-job healthy within 12.003609423s
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 addons disable volcano --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-896964 addons disable volcano --alsologtostderr -v=1: (11.182365489s)
--- PASS: TestAddons/serial/Volcano (39.82s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.19s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:569: (dbg) Run:  kubectl --context addons-896964 create ns new-namespace
addons_test.go:583: (dbg) Run:  kubectl --context addons-896964 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.19s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/FakeCredentials (10.92s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/FakeCredentials
addons_test.go:614: (dbg) Run:  kubectl --context addons-896964 create -f testdata/busybox.yaml
addons_test.go:621: (dbg) Run:  kubectl --context addons-896964 create sa gcp-auth-test
addons_test.go:627: (dbg) TestAddons/serial/GCPAuth/FakeCredentials: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [17c243b4-cbd9-41fd-834f-4862590ba8cb] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [17c243b4-cbd9-41fd-834f-4862590ba8cb] Running
addons_test.go:627: (dbg) TestAddons/serial/GCPAuth/FakeCredentials: integration-test=busybox healthy within 10.003848577s
addons_test.go:633: (dbg) Run:  kubectl --context addons-896964 exec busybox -- /bin/sh -c "printenv GOOGLE_APPLICATION_CREDENTIALS"
addons_test.go:645: (dbg) Run:  kubectl --context addons-896964 describe sa gcp-auth-test
addons_test.go:659: (dbg) Run:  kubectl --context addons-896964 exec busybox -- /bin/sh -c "cat /google-app-creds.json"
addons_test.go:683: (dbg) Run:  kubectl --context addons-896964 exec busybox -- /bin/sh -c "printenv GOOGLE_CLOUD_PROJECT"
--- PASS: TestAddons/serial/GCPAuth/FakeCredentials (10.92s)

                                                
                                    
x
+
TestAddons/parallel/Registry (17.5s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:321: registry stabilized in 4.020434ms
addons_test.go:323: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-66c9cd494c-dp2gm" [a69d55a9-1ce8-414a-95ca-39a314a5d512] Running
addons_test.go:323: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 6.004063424s
addons_test.go:326: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-k4fgj" [3cf5de81-de39-4b72-b7ab-8582f204287c] Running
addons_test.go:326: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 6.004085099s
addons_test.go:331: (dbg) Run:  kubectl --context addons-896964 delete po -l run=registry-test --now
addons_test.go:336: (dbg) Run:  kubectl --context addons-896964 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:336: (dbg) Done: kubectl --context addons-896964 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (4.247766955s)
addons_test.go:350: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 ip
2024/10/28 17:06:17 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (17.50s)

                                                
                                    
x
+
TestAddons/parallel/Ingress (19.51s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:207: (dbg) Run:  kubectl --context addons-896964 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:232: (dbg) Run:  kubectl --context addons-896964 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:245: (dbg) Run:  kubectl --context addons-896964 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [3ec32aa1-2dbf-4fe5-bba2-2e03f92bb0ce] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [3ec32aa1-2dbf-4fe5-bba2-2e03f92bb0ce] Running
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 9.003376147s
I1028 17:07:37.888276    7866 kapi.go:150] Service nginx in namespace default found.
addons_test.go:262: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:286: (dbg) Run:  kubectl --context addons-896964 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:291: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 ip
addons_test.go:297: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-896964 addons disable ingress-dns --alsologtostderr -v=1: (1.026448361s)
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 addons disable ingress --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-896964 addons disable ingress --alsologtostderr -v=1: (7.82734731s)
--- PASS: TestAddons/parallel/Ingress (19.51s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.75s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:762: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-plhn2" [0abb6209-6552-4f1b-959a-e67fc0889283] Running
addons_test.go:762: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.004268718s
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 addons disable inspektor-gadget --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-896964 addons disable inspektor-gadget --alsologtostderr -v=1: (5.74113343s)
--- PASS: TestAddons/parallel/InspektorGadget (10.75s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (6.94s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:394: metrics-server stabilized in 3.685801ms
addons_test.go:396: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-84c5f94fbc-pp8dz" [48eae61b-a5af-40a2-b610-045640f9fb1e] Running
addons_test.go:396: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 6.003595198s
addons_test.go:402: (dbg) Run:  kubectl --context addons-896964 top pods -n kube-system
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (6.94s)

                                                
                                    
x
+
TestAddons/parallel/CSI (45.66s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
I1028 17:06:42.631709    7866 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I1028 17:06:42.637687    7866 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I1028 17:06:42.637721    7866 kapi.go:107] duration metric: took 7.892736ms to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
addons_test.go:488: csi-hostpath-driver pods stabilized in 7.903189ms
addons_test.go:491: (dbg) Run:  kubectl --context addons-896964 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:496: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:501: (dbg) Run:  kubectl --context addons-896964 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:506: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [23d5e310-0109-4ba4-9873-5d8baa51d693] Pending
helpers_test.go:344: "task-pv-pod" [23d5e310-0109-4ba4-9873-5d8baa51d693] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [23d5e310-0109-4ba4-9873-5d8baa51d693] Running
addons_test.go:506: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 8.004077077s
addons_test.go:511: (dbg) Run:  kubectl --context addons-896964 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:516: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-896964 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-896964 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:521: (dbg) Run:  kubectl --context addons-896964 delete pod task-pv-pod
addons_test.go:527: (dbg) Run:  kubectl --context addons-896964 delete pvc hpvc
addons_test.go:533: (dbg) Run:  kubectl --context addons-896964 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:538: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:543: (dbg) Run:  kubectl --context addons-896964 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:548: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [4b1b606f-2168-4650-8108-d0ce908aebe7] Pending
helpers_test.go:344: "task-pv-pod-restore" [4b1b606f-2168-4650-8108-d0ce908aebe7] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [4b1b606f-2168-4650-8108-d0ce908aebe7] Running
addons_test.go:548: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.005934111s
addons_test.go:553: (dbg) Run:  kubectl --context addons-896964 delete pod task-pv-pod-restore
addons_test.go:557: (dbg) Run:  kubectl --context addons-896964 delete pvc hpvc-restore
addons_test.go:561: (dbg) Run:  kubectl --context addons-896964 delete volumesnapshot new-snapshot-demo
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 addons disable volumesnapshots --alsologtostderr -v=1
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-896964 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.850081125s)
--- PASS: TestAddons/parallel/CSI (45.66s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (17s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:747: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-896964 --alsologtostderr -v=1
addons_test.go:747: (dbg) Done: out/minikube-linux-arm64 addons enable headlamp -p addons-896964 --alsologtostderr -v=1: (1.068118575s)
addons_test.go:752: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-7b5c95b59d-8qqbs" [3288661c-a6be-4896-a961-862edebce8fa] Pending
helpers_test.go:344: "headlamp-7b5c95b59d-8qqbs" [3288661c-a6be-4896-a961-862edebce8fa] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-7b5c95b59d-8qqbs" [3288661c-a6be-4896-a961-862edebce8fa] Running
addons_test.go:752: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 10.003453218s
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 addons disable headlamp --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-896964 addons disable headlamp --alsologtostderr -v=1: (5.930664937s)
--- PASS: TestAddons/parallel/Headlamp (17.00s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (6.72s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:779: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-5b584cc74-gvpnf" [6d2febf6-ff73-4a2b-9017-d0f6aa63febf] Running
addons_test.go:779: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 6.003910539s
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 addons disable cloud-spanner --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CloudSpanner (6.72s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (54.15s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:888: (dbg) Run:  kubectl --context addons-896964 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:894: (dbg) Run:  kubectl --context addons-896964 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:898: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-896964 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:901: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [fcaf34d3-384c-41e9-9c31-37b6eb20a15a] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [fcaf34d3-384c-41e9-9c31-37b6eb20a15a] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [fcaf34d3-384c-41e9-9c31-37b6eb20a15a] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:901: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 4.003611663s
addons_test.go:906: (dbg) Run:  kubectl --context addons-896964 get pvc test-pvc -o=json
addons_test.go:915: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 ssh "cat /opt/local-path-provisioner/pvc-684a4782-ef3a-4613-ba18-312c4a95a5d7_default_test-pvc/file1"
addons_test.go:927: (dbg) Run:  kubectl --context addons-896964 delete pod test-local-path
addons_test.go:931: (dbg) Run:  kubectl --context addons-896964 delete pvc test-pvc
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-896964 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (43.670874916s)
--- PASS: TestAddons/parallel/LocalPath (54.15s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (5.85s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:964: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-vc7qm" [ef853433-2546-4216-b9cc-8c8082dff671] Running
addons_test.go:964: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 5.004797493s
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 addons disable nvidia-device-plugin --alsologtostderr -v=1
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (5.85s)

                                                
                                    
x
+
TestAddons/parallel/Yakd (11.8s)

                                                
                                                
=== RUN   TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Yakd
addons_test.go:986: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:344: "yakd-dashboard-67d98fc6b-rgcqv" [b798f483-04ee-4a85-8578-186c295366a6] Running
addons_test.go:986: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 6.003578746s
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-896964 addons disable yakd --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-896964 addons disable yakd --alsologtostderr -v=1: (5.799864327s)
--- PASS: TestAddons/parallel/Yakd (11.80s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (12.77s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:170: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-896964
addons_test.go:170: (dbg) Done: out/minikube-linux-arm64 stop -p addons-896964: (12.054776352s)
addons_test.go:174: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-896964
addons_test.go:178: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-896964
addons_test.go:183: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-896964
--- PASS: TestAddons/StoppedEnableDisable (12.77s)

                                                
                                    
x
+
TestCertOptions (38.41s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-636992 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd
cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-636992 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd: (35.688112934s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-636992 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-636992 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-636992 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-636992" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-636992
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-636992: (2.007920112s)
--- PASS: TestCertOptions (38.41s)

                                                
                                    
x
+
TestCertExpiration (228.68s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-568092 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd
cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-568092 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd: (37.672326376s)
E1028 17:47:15.753076    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-568092 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd
cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-568092 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd: (8.659270084s)
helpers_test.go:175: Cleaning up "cert-expiration-568092" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-568092
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-568092: (2.346607423s)
--- PASS: TestCertExpiration (228.68s)

                                                
                                    
x
+
TestForceSystemdFlag (41.58s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-884615 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
docker_test.go:91: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-884615 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (38.496390057s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-884615 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-flag-884615" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-884615
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-884615: (2.687964392s)
--- PASS: TestForceSystemdFlag (41.58s)

                                                
                                    
x
+
TestForceSystemdEnv (38.86s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-151163 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
docker_test.go:155: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-151163 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (36.203431096s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-env-151163 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-env-151163" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-151163
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-151163: (2.263079455s)
--- PASS: TestForceSystemdEnv (38.86s)

                                                
                                    
x
+
TestDockerEnvContainerd (44.62s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with containerd true linux arm64
docker_test.go:181: (dbg) Run:  out/minikube-linux-arm64 start -p dockerenv-782050 --driver=docker  --container-runtime=containerd
docker_test.go:181: (dbg) Done: out/minikube-linux-arm64 start -p dockerenv-782050 --driver=docker  --container-runtime=containerd: (28.794956708s)
docker_test.go:189: (dbg) Run:  /bin/bash -c "out/minikube-linux-arm64 docker-env --ssh-host --ssh-add -p dockerenv-782050"
docker_test.go:189: (dbg) Done: /bin/bash -c "out/minikube-linux-arm64 docker-env --ssh-host --ssh-add -p dockerenv-782050": (1.204130246s)
docker_test.go:220: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-qCNXtiuVE0BM/agent.29944" SSH_AGENT_PID="29945" DOCKER_HOST=ssh://docker@127.0.0.1:32773 docker version"
docker_test.go:243: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-qCNXtiuVE0BM/agent.29944" SSH_AGENT_PID="29945" DOCKER_HOST=ssh://docker@127.0.0.1:32773 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env"
docker_test.go:243: (dbg) Done: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-qCNXtiuVE0BM/agent.29944" SSH_AGENT_PID="29945" DOCKER_HOST=ssh://docker@127.0.0.1:32773 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env": (1.273812894s)
docker_test.go:250: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-qCNXtiuVE0BM/agent.29944" SSH_AGENT_PID="29945" DOCKER_HOST=ssh://docker@127.0.0.1:32773 docker image ls"
helpers_test.go:175: Cleaning up "dockerenv-782050" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p dockerenv-782050
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p dockerenv-782050: (1.960063645s)
--- PASS: TestDockerEnvContainerd (44.62s)

                                                
                                    
x
+
TestErrorSpam/setup (30.12s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-800012 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-800012 --driver=docker  --container-runtime=containerd
error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-800012 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-800012 --driver=docker  --container-runtime=containerd: (30.122567679s)
--- PASS: TestErrorSpam/setup (30.12s)

                                                
                                    
x
+
TestErrorSpam/start (0.71s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 start --dry-run
--- PASS: TestErrorSpam/start (0.71s)

                                                
                                    
x
+
TestErrorSpam/status (1.06s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 status
--- PASS: TestErrorSpam/status (1.06s)

                                                
                                    
x
+
TestErrorSpam/pause (1.79s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 pause
--- PASS: TestErrorSpam/pause (1.79s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.88s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 unpause
--- PASS: TestErrorSpam/unpause (1.88s)

                                                
                                    
x
+
TestErrorSpam/stop (1.48s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 stop: (1.287560798s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-800012 --log_dir /tmp/nospam-800012 stop
--- PASS: TestErrorSpam/stop (1.48s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1855: local sync path: /home/jenkins/minikube-integration/19872-2421/.minikube/files/etc/test/nested/copy/7866/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (92.43s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2234: (dbg) Run:  out/minikube-linux-arm64 start -p functional-137003 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd
E1028 17:10:01.085603    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:10:01.092587    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:10:01.103999    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:10:01.125369    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:10:01.167125    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:10:01.248967    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:10:01.410291    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:10:01.732280    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:10:02.374944    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:10:03.656623    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:10:06.218252    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:10:11.340059    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:10:21.581524    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:10:42.063576    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
functional_test.go:2234: (dbg) Done: out/minikube-linux-arm64 start -p functional-137003 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd: (1m32.426502047s)
--- PASS: TestFunctional/serial/StartWithProxy (92.43s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (6.88s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
I1028 17:11:04.241236    7866 config.go:182] Loaded profile config "functional-137003": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
functional_test.go:659: (dbg) Run:  out/minikube-linux-arm64 start -p functional-137003 --alsologtostderr -v=8
functional_test.go:659: (dbg) Done: out/minikube-linux-arm64 start -p functional-137003 --alsologtostderr -v=8: (6.880153901s)
functional_test.go:663: soft start took 6.882720589s for "functional-137003" cluster.
I1028 17:11:11.121747    7866 config.go:182] Loaded profile config "functional-137003": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
--- PASS: TestFunctional/serial/SoftStart (6.88s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:681: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.07s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.12s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:696: (dbg) Run:  kubectl --context functional-137003 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.12s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (4.29s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1049: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 cache add registry.k8s.io/pause:3.1
functional_test.go:1049: (dbg) Done: out/minikube-linux-arm64 -p functional-137003 cache add registry.k8s.io/pause:3.1: (1.553961714s)
functional_test.go:1049: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 cache add registry.k8s.io/pause:3.3
functional_test.go:1049: (dbg) Done: out/minikube-linux-arm64 -p functional-137003 cache add registry.k8s.io/pause:3.3: (1.478735996s)
functional_test.go:1049: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 cache add registry.k8s.io/pause:latest
functional_test.go:1049: (dbg) Done: out/minikube-linux-arm64 -p functional-137003 cache add registry.k8s.io/pause:latest: (1.253728319s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (4.29s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.18s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1077: (dbg) Run:  docker build -t minikube-local-cache-test:functional-137003 /tmp/TestFunctionalserialCacheCmdcacheadd_local3466584442/001
functional_test.go:1089: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 cache add minikube-local-cache-test:functional-137003
functional_test.go:1094: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 cache delete minikube-local-cache-test:functional-137003
functional_test.go:1083: (dbg) Run:  docker rmi minikube-local-cache-test:functional-137003
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.18s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1102: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1110: (dbg) Run:  out/minikube-linux-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.31s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1124: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.31s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (2.04s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1147: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh sudo crictl rmi registry.k8s.io/pause:latest
functional_test.go:1153: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1153: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-137003 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (300.040262ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1158: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 cache reload
functional_test.go:1158: (dbg) Done: out/minikube-linux-arm64 -p functional-137003 cache reload: (1.107462592s)
functional_test.go:1163: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (2.04s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.12s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1172: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1172: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.12s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:716: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 kubectl -- --context functional-137003 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:741: (dbg) Run:  out/kubectl --context functional-137003 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.14s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (46.68s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:757: (dbg) Run:  out/minikube-linux-arm64 start -p functional-137003 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E1028 17:11:23.025475    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
functional_test.go:757: (dbg) Done: out/minikube-linux-arm64 start -p functional-137003 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (46.676758628s)
functional_test.go:761: restart took 46.676856858s for "functional-137003" cluster.
I1028 17:12:06.316434    7866 config.go:182] Loaded profile config "functional-137003": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
--- PASS: TestFunctional/serial/ExtraConfig (46.68s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:810: (dbg) Run:  kubectl --context functional-137003 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:825: etcd phase: Running
functional_test.go:835: etcd status: Ready
functional_test.go:825: kube-apiserver phase: Running
functional_test.go:835: kube-apiserver status: Ready
functional_test.go:825: kube-controller-manager phase: Running
functional_test.go:835: kube-controller-manager status: Ready
functional_test.go:825: kube-scheduler phase: Running
functional_test.go:835: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.10s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.7s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1236: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 logs
functional_test.go:1236: (dbg) Done: out/minikube-linux-arm64 -p functional-137003 logs: (1.704508151s)
--- PASS: TestFunctional/serial/LogsCmd (1.70s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.66s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1250: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 logs --file /tmp/TestFunctionalserialLogsFileCmd3437611969/001/logs.txt
functional_test.go:1250: (dbg) Done: out/minikube-linux-arm64 -p functional-137003 logs --file /tmp/TestFunctionalserialLogsFileCmd3437611969/001/logs.txt: (1.663501039s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.66s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.12s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2321: (dbg) Run:  kubectl --context functional-137003 apply -f testdata/invalidsvc.yaml
functional_test.go:2335: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-137003
functional_test.go:2335: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-137003: exit status 115 (430.638371ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:32102 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2327: (dbg) Run:  kubectl --context functional-137003 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (4.12s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 config unset cpus
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 config get cpus
functional_test.go:1199: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-137003 config get cpus: exit status 14 (88.989258ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 config set cpus 2
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 config get cpus
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 config unset cpus
functional_test.go:1199: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 config get cpus
functional_test.go:1199: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-137003 config get cpus: exit status 14 (92.071017ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.53s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (7.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:905: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-137003 --alsologtostderr -v=1]
functional_test.go:910: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-137003 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 44606: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (7.16s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.42s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:974: (dbg) Run:  out/minikube-linux-arm64 start -p functional-137003 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:974: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-137003 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (186.926654ms)

                                                
                                                
-- stdout --
	* [functional-137003] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19872
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 17:12:47.891144   44367 out.go:345] Setting OutFile to fd 1 ...
	I1028 17:12:47.891339   44367 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:12:47.891365   44367 out.go:358] Setting ErrFile to fd 2...
	I1028 17:12:47.891386   44367 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:12:47.891687   44367 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
	I1028 17:12:47.892205   44367 out.go:352] Setting JSON to false
	I1028 17:12:47.893492   44367 start.go:129] hostinfo: {"hostname":"ip-172-31-24-2","uptime":3314,"bootTime":1730132254,"procs":213,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"6d436adf-771e-4269-b9a3-c25fd4fca4f5"}
	I1028 17:12:47.893595   44367 start.go:139] virtualization:  
	I1028 17:12:47.895987   44367 out.go:177] * [functional-137003] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	I1028 17:12:47.898376   44367 out.go:177]   - MINIKUBE_LOCATION=19872
	I1028 17:12:47.898433   44367 notify.go:220] Checking for updates...
	I1028 17:12:47.900493   44367 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 17:12:47.902640   44367 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig
	I1028 17:12:47.905046   44367 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube
	I1028 17:12:47.907440   44367 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I1028 17:12:47.909711   44367 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 17:12:47.912638   44367 config.go:182] Loaded profile config "functional-137003": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
	I1028 17:12:47.913153   44367 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 17:12:47.943519   44367 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
	I1028 17:12:47.943652   44367 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1028 17:12:48.003171   44367 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:32 OomKillDisable:true NGoroutines:52 SystemTime:2024-10-28 17:12:47.992694446 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I1028 17:12:48.003290   44367 docker.go:318] overlay module found
	I1028 17:12:48.006989   44367 out.go:177] * Using the docker driver based on existing profile
	I1028 17:12:48.011503   44367 start.go:297] selected driver: docker
	I1028 17:12:48.011533   44367 start.go:901] validating driver "docker" against &{Name:functional-137003 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:functional-137003 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 17:12:48.011676   44367 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 17:12:48.015246   44367 out.go:201] 
	W1028 17:12:48.018802   44367 out.go:270] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I1028 17:12:48.020972   44367 out.go:201] 

                                                
                                                
** /stderr **
functional_test.go:991: (dbg) Run:  out/minikube-linux-arm64 start -p functional-137003 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
--- PASS: TestFunctional/parallel/DryRun (0.42s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1020: (dbg) Run:  out/minikube-linux-arm64 start -p functional-137003 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:1020: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-137003 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (246.46914ms)

                                                
                                                
-- stdout --
	* [functional-137003] minikube v1.34.0 sur Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19872
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 17:12:47.676298   44261 out.go:345] Setting OutFile to fd 1 ...
	I1028 17:12:47.676535   44261 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:12:47.676574   44261 out.go:358] Setting ErrFile to fd 2...
	I1028 17:12:47.676593   44261 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:12:47.677565   44261 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
	I1028 17:12:47.678000   44261 out.go:352] Setting JSON to false
	I1028 17:12:47.678939   44261 start.go:129] hostinfo: {"hostname":"ip-172-31-24-2","uptime":3314,"bootTime":1730132254,"procs":212,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"6d436adf-771e-4269-b9a3-c25fd4fca4f5"}
	I1028 17:12:47.679036   44261 start.go:139] virtualization:  
	I1028 17:12:47.682345   44261 out.go:177] * [functional-137003] minikube v1.34.0 sur Ubuntu 20.04 (arm64)
	I1028 17:12:47.685756   44261 out.go:177]   - MINIKUBE_LOCATION=19872
	I1028 17:12:47.685821   44261 notify.go:220] Checking for updates...
	I1028 17:12:47.688308   44261 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 17:12:47.690909   44261 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig
	I1028 17:12:47.693407   44261 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube
	I1028 17:12:47.696177   44261 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I1028 17:12:47.698538   44261 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 17:12:47.701219   44261 config.go:182] Loaded profile config "functional-137003": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
	I1028 17:12:47.701782   44261 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 17:12:47.743311   44261 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
	I1028 17:12:47.743449   44261 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1028 17:12:47.819980   44261 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:32 OomKillDisable:true NGoroutines:52 SystemTime:2024-10-28 17:12:47.802058635 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I1028 17:12:47.820087   44261 docker.go:318] overlay module found
	I1028 17:12:47.823964   44261 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I1028 17:12:47.825844   44261 start.go:297] selected driver: docker
	I1028 17:12:47.825862   44261 start.go:901] validating driver "docker" against &{Name:functional-137003 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730110049-19872@sha256:ead1232eaf026cb87df5e47192f652e5fef1a28f5a05a9ac9cb1a241cca351e9 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:functional-137003 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.31.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I1028 17:12:47.825972   44261 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 17:12:47.828846   44261 out.go:201] 
	W1028 17:12:47.831005   44261 out.go:270] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I1028 17:12:47.833047   44261 out.go:201] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (1.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:854: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 status
functional_test.go:860: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:872: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.30s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (11.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1627: (dbg) Run:  kubectl --context functional-137003 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1635: (dbg) Run:  kubectl --context functional-137003 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-65d86f57f4-crkh9" [a6ff21d5-5602-47a9-ab19-98ca1d53301f] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-connect-65d86f57f4-crkh9" [a6ff21d5-5602-47a9-ab19-98ca1d53301f] Running
functional_test.go:1640: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 11.004433685s
functional_test.go:1649: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 service hello-node-connect --url
functional_test.go:1655: found endpoint for hello-node-connect: http://192.168.49.2:31968
functional_test.go:1675: http://192.168.49.2:31968: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-65d86f57f4-crkh9

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:31968
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (11.70s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1690: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 addons list
functional_test.go:1702: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (27.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [631f4311-67e0-4797-9897-d608d9a0d702] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 6.004169715s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-137003 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-137003 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-137003 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-137003 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [05ea3db3-28ee-40b7-8aa6-405d87148092] Pending
helpers_test.go:344: "sp-pod" [05ea3db3-28ee-40b7-8aa6-405d87148092] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [05ea3db3-28ee-40b7-8aa6-405d87148092] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 11.004331054s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-137003 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-137003 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:106: (dbg) Done: kubectl --context functional-137003 delete -f testdata/storage-provisioner/pod.yaml: (2.034150855s)
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-137003 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [1bd874ec-55e4-42ae-b9ca-de19cb44b78c] Pending
helpers_test.go:344: "sp-pod" [1bd874ec-55e4-42ae-b9ca-de19cb44b78c] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 7.003510282s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-137003 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (27.10s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.65s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1725: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "echo hello"
functional_test.go:1742: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.65s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (2.36s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh -n functional-137003 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 cp functional-137003:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd3913012725/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh -n functional-137003 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh -n functional-137003 "sudo cat /tmp/does/not/exist/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (2.36s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.36s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1929: Checking for existence of /etc/test/nested/copy/7866/hosts within VM
functional_test.go:1931: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "sudo cat /etc/test/nested/copy/7866/hosts"
functional_test.go:1936: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.36s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (2.48s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1972: Checking for existence of /etc/ssl/certs/7866.pem within VM
functional_test.go:1973: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "sudo cat /etc/ssl/certs/7866.pem"
functional_test.go:1972: Checking for existence of /usr/share/ca-certificates/7866.pem within VM
functional_test.go:1973: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "sudo cat /usr/share/ca-certificates/7866.pem"
functional_test.go:1972: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1973: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1999: Checking for existence of /etc/ssl/certs/78662.pem within VM
functional_test.go:2000: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "sudo cat /etc/ssl/certs/78662.pem"
functional_test.go:1999: Checking for existence of /usr/share/ca-certificates/78662.pem within VM
functional_test.go:2000: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "sudo cat /usr/share/ca-certificates/78662.pem"
functional_test.go:1999: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:2000: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (2.48s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:219: (dbg) Run:  kubectl --context functional-137003 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2027: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "sudo systemctl is-active docker"
functional_test.go:2027: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-137003 ssh "sudo systemctl is-active docker": exit status 1 (374.421783ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
functional_test.go:2027: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "sudo systemctl is-active crio"
functional_test.go:2027: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-137003 ssh "sudo systemctl is-active crio": exit status 1 (323.845407ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.70s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.29s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2288: (dbg) Run:  out/minikube-linux-arm64 license
--- PASS: TestFunctional/parallel/License (0.29s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.67s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-137003 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-137003 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-137003 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 41772: os: process already finished
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-137003 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.67s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-arm64 -p functional-137003 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.46s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-137003 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [4b9a360e-545c-433a-8b9d-a384f0d21f6d] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [4b9a360e-545c-433a-8b9d-a384f0d21f6d] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 8.004918185s
I1028 17:12:24.210464    7866 kapi.go:150] Service nginx-svc in namespace default found.
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.46s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-137003 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.103.104.23 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-arm64 -p functional-137003 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (7.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1437: (dbg) Run:  kubectl --context functional-137003 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1445: (dbg) Run:  kubectl --context functional-137003 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1450: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-64b4f8f9ff-78bjs" [ce257456-5572-42b0-9df8-1530c56c527a] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-64b4f8f9ff-78bjs" [ce257456-5572-42b0-9df8-1530c56c527a] Running
functional_test.go:1450: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 7.004009538s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (7.26s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1270: (dbg) Run:  out/minikube-linux-arm64 profile lis
functional_test.go:1275: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.58s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1459: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.58s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.56s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1310: (dbg) Run:  out/minikube-linux-arm64 profile list
functional_test.go:1315: Took "481.886349ms" to run "out/minikube-linux-arm64 profile list"
functional_test.go:1324: (dbg) Run:  out/minikube-linux-arm64 profile list -l
functional_test.go:1329: Took "79.422374ms" to run "out/minikube-linux-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.56s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.61s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1489: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 service list -o json
functional_test.go:1494: Took "612.302997ms" to run "out/minikube-linux-arm64 -p functional-137003 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.61s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.48s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1361: (dbg) Run:  out/minikube-linux-arm64 profile list -o json
functional_test.go:1366: Took "401.190834ms" to run "out/minikube-linux-arm64 profile list -o json"
functional_test.go:1374: (dbg) Run:  out/minikube-linux-arm64 profile list -o json --light
functional_test.go:1379: Took "75.196325ms" to run "out/minikube-linux-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.48s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.63s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1509: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 service --namespace=default --https --url hello-node
functional_test.go:1522: found endpoint: https://192.168.49.2:32512
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.63s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (9.77s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-137003 /tmp/TestFunctionalparallelMountCmdany-port1111125598/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1730135564897425385" to /tmp/TestFunctionalparallelMountCmdany-port1111125598/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1730135564897425385" to /tmp/TestFunctionalparallelMountCmdany-port1111125598/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1730135564897425385" to /tmp/TestFunctionalparallelMountCmdany-port1111125598/001/test-1730135564897425385
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "findmnt -T /mount-9p | grep 9p"
E1028 17:12:44.947142    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-137003 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (585.030617ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
I1028 17:12:45.483349    7866 retry.go:31] will retry after 562.58439ms: exit status 1
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Oct 28 17:12 created-by-test
-rw-r--r-- 1 docker docker 24 Oct 28 17:12 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Oct 28 17:12 test-1730135564897425385
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh cat /mount-9p/test-1730135564897425385
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-137003 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [f51c0e0e-8e61-4ffb-be97-897b0ee04c9f] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [f51c0e0e-8e61-4ffb-be97-897b0ee04c9f] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [f51c0e0e-8e61-4ffb-be97-897b0ee04c9f] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 6.004498146s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-137003 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-137003 /tmp/TestFunctionalparallelMountCmdany-port1111125598/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (9.77s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.43s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1540: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.43s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1559: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 service hello-node --url
functional_test.go:1565: found endpoint for hello-node: http://192.168.49.2:32512
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.45s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (2.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-137003 /tmp/TestFunctionalparallelMountCmdspecific-port920438773/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-137003 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (413.978814ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
I1028 17:12:55.079709    7866 retry.go:31] will retry after 449.638728ms: exit status 1
2024/10/28 17:12:55 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-137003 /tmp/TestFunctionalparallelMountCmdspecific-port920438773/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-137003 ssh "sudo umount -f /mount-9p": exit status 1 (303.614581ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-137003 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-137003 /tmp/TestFunctionalparallelMountCmdspecific-port920438773/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.11s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2256: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 version --short
--- PASS: TestFunctional/parallel/Version/short (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (1.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2270: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 version -o=json --components
functional_test.go:2270: (dbg) Done: out/minikube-linux-arm64 -p functional-137003 version -o=json --components: (1.329634883s)
--- PASS: TestFunctional/parallel/Version/components (1.33s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image ls --format short --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-linux-arm64 -p functional-137003 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.10
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.31.2
registry.k8s.io/kube-proxy:v1.31.2
registry.k8s.io/kube-controller-manager:v1.31.2
registry.k8s.io/kube-apiserver:v1.31.2
registry.k8s.io/etcd:3.5.15-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.11.3
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/minikube-local-cache-test:functional-137003
docker.io/kindest/kindnetd:v20241007-36f62932
docker.io/kicbase/echo-server:functional-137003
functional_test.go:269: (dbg) Stderr: out/minikube-linux-arm64 -p functional-137003 image ls --format short --alsologtostderr:
I1028 17:13:04.681234   47268 out.go:345] Setting OutFile to fd 1 ...
I1028 17:13:04.681414   47268 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 17:13:04.681443   47268 out.go:358] Setting ErrFile to fd 2...
I1028 17:13:04.681462   47268 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 17:13:04.682189   47268 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
I1028 17:13:04.683435   47268 config.go:182] Loaded profile config "functional-137003": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
I1028 17:13:04.683602   47268 config.go:182] Loaded profile config "functional-137003": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
I1028 17:13:04.684448   47268 cli_runner.go:164] Run: docker container inspect functional-137003 --format={{.State.Status}}
I1028 17:13:04.706955   47268 ssh_runner.go:195] Run: systemctl --version
I1028 17:13:04.707013   47268 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-137003
I1028 17:13:04.731670   47268 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/functional-137003/id_rsa Username:docker}
I1028 17:13:04.829553   47268 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.30s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image ls --format table --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-linux-arm64 -p functional-137003 image ls --format table --alsologtostderr:
|---------------------------------------------|--------------------|---------------|--------|
|                    Image                    |        Tag         |   Image ID    |  Size  |
|---------------------------------------------|--------------------|---------------|--------|
| registry.k8s.io/pause                       | 3.10               | sha256:afb617 | 268kB  |
| docker.io/kindest/kindnetd                  | v20241007-36f62932 | sha256:0bcd66 | 35.3MB |
| docker.io/kicbase/echo-server               | functional-137003  | sha256:ce2d2c | 2.17MB |
| docker.io/library/minikube-local-cache-test | functional-137003  | sha256:899ead | 991B   |
| docker.io/library/nginx                     | alpine             | sha256:577a23 | 21.5MB |
| docker.io/library/nginx                     | latest             | sha256:4b1965 | 69.6MB |
| registry.k8s.io/coredns/coredns             | v1.11.3            | sha256:2f6c96 | 16.9MB |
| gcr.io/k8s-minikube/storage-provisioner     | v5                 | sha256:ba04bb | 8.03MB |
| registry.k8s.io/kube-controller-manager     | v1.31.2            | sha256:9404ae | 23.9MB |
| registry.k8s.io/kube-scheduler              | v1.31.2            | sha256:d6b061 | 18.4MB |
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc       | sha256:1611cd | 1.94MB |
| registry.k8s.io/echoserver-arm              | 1.8                | sha256:72565b | 45.3MB |
| registry.k8s.io/etcd                        | 3.5.15-0           | sha256:27e383 | 66.5MB |
| registry.k8s.io/kube-apiserver              | v1.31.2            | sha256:f9c264 | 25.6MB |
| registry.k8s.io/kube-proxy                  | v1.31.2            | sha256:021d24 | 26.8MB |
| registry.k8s.io/pause                       | 3.1                | sha256:8057e0 | 262kB  |
| registry.k8s.io/pause                       | 3.3                | sha256:3d1873 | 249kB  |
| registry.k8s.io/pause                       | latest             | sha256:8cb209 | 71.3kB |
|---------------------------------------------|--------------------|---------------|--------|
functional_test.go:269: (dbg) Stderr: out/minikube-linux-arm64 -p functional-137003 image ls --format table --alsologtostderr:
I1028 17:13:05.232591   47421 out.go:345] Setting OutFile to fd 1 ...
I1028 17:13:05.232781   47421 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 17:13:05.232807   47421 out.go:358] Setting ErrFile to fd 2...
I1028 17:13:05.232826   47421 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 17:13:05.233330   47421 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
I1028 17:13:05.234367   47421 config.go:182] Loaded profile config "functional-137003": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
I1028 17:13:05.234573   47421 config.go:182] Loaded profile config "functional-137003": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
I1028 17:13:05.235308   47421 cli_runner.go:164] Run: docker container inspect functional-137003 --format={{.State.Status}}
I1028 17:13:05.281937   47421 ssh_runner.go:195] Run: systemctl --version
I1028 17:13:05.281991   47421 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-137003
I1028 17:13:05.326126   47421 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/functional-137003/id_rsa Username:docker}
I1028 17:13:05.424799   47421 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.30s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image ls --format json --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-linux-arm64 -p functional-137003 image ls --format json --alsologtostderr:
[{"id":"sha256:27e3830e1402783674d8b594038967deea9d51f0d91b34c93c8f39d2f68af7da","repoDigests":["registry.k8s.io/etcd@sha256:a6dc63e6e8cfa0307d7851762fa6b629afb18f28d8aa3fab5a6e91b4af60026a"],"repoTags":["registry.k8s.io/etcd:3.5.15-0"],"size":"66535646"},{"id":"sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8","repoDigests":["registry.k8s.io/pause@sha256:ee6521f290b2168b6e0935a181d4cff9be1ac3f505666ef0e3c98fae8199917a"],"repoTags":["registry.k8s.io/pause:3.10"],"size":"267933"},{"id":"sha256:8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"71300"},{"id":"sha256:9404aea098d9e80cb648d86c07d56130a1fe875ed7c2526251c2ae68a9bf07ba","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:a33795e8b0ff9923d1539331975c4e76e2a74090f9f82eca775e2390e4f20752"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.31.2"],"size":"23872272"},{"id":"sha256:021d2420133054f8835987db659750ff639ab686377646
0264dd8025c06644ba","repoDigests":["registry.k8s.io/kube-proxy@sha256:62128d752eb4a9162074697aba46adea4abb8aab2a53c992f20881365b61a4fe"],"repoTags":["registry.k8s.io/kube-proxy:v1.31.2"],"size":"26768683"},{"id":"sha256:8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"262191"},{"id":"sha256:3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"249461"},{"id":"sha256:a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a","repoDigests":["docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"],"repoTags":[],"size":"18306114"},{"id":"sha256:2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4","repoDigests":["registry.k8s.io/coredns/coredns@sha256:9caabbf6238b189a65d0d6e6ac138de60d6a1c419e5a341fbbb7c78382559c6e"],"repoTags":["registry.k8s.io/coredns/coredns:v1.11.3"],"size":"1
6948420"},{"id":"sha256:72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":["registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5"],"repoTags":["registry.k8s.io/echoserver-arm:1.8"],"size":"45324675"},{"id":"sha256:20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8","repoDigests":["docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93"],"repoTags":[],"size":"74084559"},{"id":"sha256:4b196525bd3cc6aa7a72ba63c6c2ae6d957b57edd603a7070c5e31f8e63c51f9","repoDigests":["docker.io/library/nginx@sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb"],"repoTags":["docker.io/library/nginx:latest"],"size":"69600252"},{"id":"sha256:f9c26480f1e722a7d05d7f1bb339180b19f941b23bcc928208e362df04a61270","repoDigests":["registry.k8s.io/kube-apiserver@sha256:9d12daaedff9677744993f247bfbe4950f3da8cfd38179b3c59ec66dc81dfbe0"],"repoTags":["registry.k8s.io/kube-apiserver:v1.3
1.2"],"size":"25612805"},{"id":"sha256:577a23b5858b94a1a92e4263bd5d6da99fbd997fb9839bc0f357c9d4b858f431","repoDigests":["docker.io/library/nginx@sha256:2140dad235c130ac861018a4e13a6bc8aea3a35f3a40e20c1b060d51a7efd250"],"repoTags":["docker.io/library/nginx:alpine"],"size":"21533923"},{"id":"sha256:1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"1935750"},{"id":"sha256:ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"8034419"},{"id":"sha256:d6b061e73ae454743cbfe0e3479aa23e4ed65c61d38b4408a1e7f3d3859dda8a","repoDigests":["registry.k8s.io/kube-scheduler@sha256:0f78992e985d0dbe65f3e7598943d34b725cd61a21ba92ed
f5ac29f0f2b61282"],"repoTags":["registry.k8s.io/kube-scheduler:v1.31.2"],"size":"18429679"},{"id":"sha256:ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17","repoDigests":[],"repoTags":["docker.io/kicbase/echo-server:functional-137003"],"size":"2173567"},{"id":"sha256:0bcd66b03df5f1498fba5b90226939f5993cfba4c8379438bd8e89f3b4a70baa","repoDigests":["docker.io/kindest/kindnetd@sha256:a454aa48d8e10631411378503103b251e3f52856d8be2535efb73a92fa2c0387"],"repoTags":["docker.io/kindest/kindnetd:v20241007-36f62932"],"size":"35320503"},{"id":"sha256:899ead4434764f68f3cf6e4c469bdd8d36da172ad8c230fa79fa84863365acd0","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-137003"],"size":"991"}]
functional_test.go:269: (dbg) Stderr: out/minikube-linux-arm64 -p functional-137003 image ls --format json --alsologtostderr:
I1028 17:13:04.957768   47333 out.go:345] Setting OutFile to fd 1 ...
I1028 17:13:04.958202   47333 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 17:13:04.964976   47333 out.go:358] Setting ErrFile to fd 2...
I1028 17:13:04.964998   47333 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 17:13:04.965390   47333 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
I1028 17:13:04.966485   47333 config.go:182] Loaded profile config "functional-137003": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
I1028 17:13:04.968754   47333 config.go:182] Loaded profile config "functional-137003": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
I1028 17:13:04.969432   47333 cli_runner.go:164] Run: docker container inspect functional-137003 --format={{.State.Status}}
I1028 17:13:04.997794   47333 ssh_runner.go:195] Run: systemctl --version
I1028 17:13:04.997849   47333 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-137003
I1028 17:13:05.022495   47333 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/functional-137003/id_rsa Username:docker}
I1028 17:13:05.121477   47333 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.30s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.29s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image ls --format yaml --alsologtostderr
functional_test.go:266: (dbg) Stdout: out/minikube-linux-arm64 -p functional-137003 image ls --format yaml --alsologtostderr:
- id: sha256:0bcd66b03df5f1498fba5b90226939f5993cfba4c8379438bd8e89f3b4a70baa
repoDigests:
- docker.io/kindest/kindnetd@sha256:a454aa48d8e10631411378503103b251e3f52856d8be2535efb73a92fa2c0387
repoTags:
- docker.io/kindest/kindnetd:v20241007-36f62932
size: "35320503"
- id: sha256:2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:9caabbf6238b189a65d0d6e6ac138de60d6a1c419e5a341fbbb7c78382559c6e
repoTags:
- registry.k8s.io/coredns/coredns:v1.11.3
size: "16948420"
- id: sha256:f9c26480f1e722a7d05d7f1bb339180b19f941b23bcc928208e362df04a61270
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:9d12daaedff9677744993f247bfbe4950f3da8cfd38179b3c59ec66dc81dfbe0
repoTags:
- registry.k8s.io/kube-apiserver:v1.31.2
size: "25612805"
- id: sha256:9404aea098d9e80cb648d86c07d56130a1fe875ed7c2526251c2ae68a9bf07ba
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:a33795e8b0ff9923d1539331975c4e76e2a74090f9f82eca775e2390e4f20752
repoTags:
- registry.k8s.io/kube-controller-manager:v1.31.2
size: "23872272"
- id: sha256:8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "71300"
- id: sha256:20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8
repoDigests:
- docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93
repoTags: []
size: "74084559"
- id: sha256:ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17
repoDigests: []
repoTags:
- docker.io/kicbase/echo-server:functional-137003
size: "2173567"
- id: sha256:a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a
repoDigests:
- docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c
repoTags: []
size: "18306114"
- id: sha256:577a23b5858b94a1a92e4263bd5d6da99fbd997fb9839bc0f357c9d4b858f431
repoDigests:
- docker.io/library/nginx@sha256:2140dad235c130ac861018a4e13a6bc8aea3a35f3a40e20c1b060d51a7efd250
repoTags:
- docker.io/library/nginx:alpine
size: "21533923"
- id: sha256:4b196525bd3cc6aa7a72ba63c6c2ae6d957b57edd603a7070c5e31f8e63c51f9
repoDigests:
- docker.io/library/nginx@sha256:28402db69fec7c17e179ea87882667f1e054391138f77ffaf0c3eb388efc3ffb
repoTags:
- docker.io/library/nginx:latest
size: "69600252"
- id: sha256:ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "8034419"
- id: sha256:1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "1935750"
- id: sha256:72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests:
- registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "45324675"
- id: sha256:27e3830e1402783674d8b594038967deea9d51f0d91b34c93c8f39d2f68af7da
repoDigests:
- registry.k8s.io/etcd@sha256:a6dc63e6e8cfa0307d7851762fa6b629afb18f28d8aa3fab5a6e91b4af60026a
repoTags:
- registry.k8s.io/etcd:3.5.15-0
size: "66535646"
- id: sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8
repoDigests:
- registry.k8s.io/pause@sha256:ee6521f290b2168b6e0935a181d4cff9be1ac3f505666ef0e3c98fae8199917a
repoTags:
- registry.k8s.io/pause:3.10
size: "267933"
- id: sha256:3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "249461"
- id: sha256:899ead4434764f68f3cf6e4c469bdd8d36da172ad8c230fa79fa84863365acd0
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-137003
size: "991"
- id: sha256:021d2420133054f8835987db659750ff639ab6863776460264dd8025c06644ba
repoDigests:
- registry.k8s.io/kube-proxy@sha256:62128d752eb4a9162074697aba46adea4abb8aab2a53c992f20881365b61a4fe
repoTags:
- registry.k8s.io/kube-proxy:v1.31.2
size: "26768683"
- id: sha256:d6b061e73ae454743cbfe0e3479aa23e4ed65c61d38b4408a1e7f3d3859dda8a
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:0f78992e985d0dbe65f3e7598943d34b725cd61a21ba92edf5ac29f0f2b61282
repoTags:
- registry.k8s.io/kube-scheduler:v1.31.2
size: "18429679"
- id: sha256:8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "262191"

                                                
                                                
functional_test.go:269: (dbg) Stderr: out/minikube-linux-arm64 -p functional-137003 image ls --format yaml --alsologtostderr:
I1028 17:13:04.658001   47269 out.go:345] Setting OutFile to fd 1 ...
I1028 17:13:04.658189   47269 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 17:13:04.658201   47269 out.go:358] Setting ErrFile to fd 2...
I1028 17:13:04.658207   47269 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 17:13:04.658532   47269 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
I1028 17:13:04.659221   47269 config.go:182] Loaded profile config "functional-137003": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
I1028 17:13:04.659378   47269 config.go:182] Loaded profile config "functional-137003": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
I1028 17:13:04.659926   47269 cli_runner.go:164] Run: docker container inspect functional-137003 --format={{.State.Status}}
I1028 17:13:04.688110   47269 ssh_runner.go:195] Run: systemctl --version
I1028 17:13:04.688184   47269 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-137003
I1028 17:13:04.708892   47269 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/functional-137003/id_rsa Username:docker}
I1028 17:13:04.808950   47269 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.29s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (4.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:308: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh pgrep buildkitd
functional_test.go:308: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-137003 ssh pgrep buildkitd: exit status 1 (359.576909ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:315: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image build -t localhost/my-image:functional-137003 testdata/build --alsologtostderr
functional_test.go:315: (dbg) Done: out/minikube-linux-arm64 -p functional-137003 image build -t localhost/my-image:functional-137003 testdata/build --alsologtostderr: (3.444231366s)
functional_test.go:323: (dbg) Stderr: out/minikube-linux-arm64 -p functional-137003 image build -t localhost/my-image:functional-137003 testdata/build --alsologtostderr:
I1028 17:13:05.323590   47434 out.go:345] Setting OutFile to fd 1 ...
I1028 17:13:05.327197   47434 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 17:13:05.327231   47434 out.go:358] Setting ErrFile to fd 2...
I1028 17:13:05.327253   47434 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1028 17:13:05.327553   47434 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
I1028 17:13:05.328242   47434 config.go:182] Loaded profile config "functional-137003": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
I1028 17:13:05.329911   47434 config.go:182] Loaded profile config "functional-137003": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
I1028 17:13:05.330502   47434 cli_runner.go:164] Run: docker container inspect functional-137003 --format={{.State.Status}}
I1028 17:13:05.351725   47434 ssh_runner.go:195] Run: systemctl --version
I1028 17:13:05.351787   47434 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-137003
I1028 17:13:05.375673   47434 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/functional-137003/id_rsa Username:docker}
I1028 17:13:05.475368   47434 build_images.go:161] Building image from path: /tmp/build.1092742466.tar
I1028 17:13:05.475441   47434 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I1028 17:13:05.486865   47434 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.1092742466.tar
I1028 17:13:05.490521   47434 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.1092742466.tar: stat -c "%s %y" /var/lib/minikube/build/build.1092742466.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.1092742466.tar': No such file or directory
I1028 17:13:05.490555   47434 ssh_runner.go:362] scp /tmp/build.1092742466.tar --> /var/lib/minikube/build/build.1092742466.tar (3072 bytes)
I1028 17:13:05.521958   47434 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.1092742466
I1028 17:13:05.532025   47434 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.1092742466 -xf /var/lib/minikube/build/build.1092742466.tar
I1028 17:13:05.543168   47434 containerd.go:394] Building image: /var/lib/minikube/build/build.1092742466
I1028 17:13:05.543253   47434 ssh_runner.go:195] Run: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.1092742466 --local dockerfile=/var/lib/minikube/build/build.1092742466 --output type=image,name=localhost/my-image:functional-137003
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 97B done
#1 DONE 0.0s

                                                
                                                
#2 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#2 DONE 1.5s

                                                
                                                
#3 [internal] load .dockerignore
#3 transferring context: 2B done
#3 DONE 0.0s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox:latest@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox:latest@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0B / 828.50kB 0.2s
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.5s done
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0.1s done
#5 DONE 0.6s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 0.6s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.0s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.1s done
#8 exporting manifest sha256:73f16083d117553e1739d324db12a2c94a45b6b2915211e87e2039c07f58bb10
#8 exporting manifest sha256:73f16083d117553e1739d324db12a2c94a45b6b2915211e87e2039c07f58bb10 0.0s done
#8 exporting config sha256:3c7c0ccc6ee38fbbbc1c91f90b13d87904cf7da9a7fa8d7a86e99214c5aca95d 0.0s done
#8 naming to localhost/my-image:functional-137003 done
#8 DONE 0.1s
I1028 17:13:08.672428   47434 ssh_runner.go:235] Completed: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.1092742466 --local dockerfile=/var/lib/minikube/build/build.1092742466 --output type=image,name=localhost/my-image:functional-137003: (3.129148972s)
I1028 17:13:08.672502   47434 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.1092742466
I1028 17:13:08.681838   47434 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.1092742466.tar
I1028 17:13:08.691454   47434 build_images.go:217] Built localhost/my-image:functional-137003 from /tmp/build.1092742466.tar
I1028 17:13:08.691484   47434 build_images.go:133] succeeded building to: functional-137003
I1028 17:13:08.691489   47434 build_images.go:134] failed building to: 
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (4.06s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (0.89s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:342: (dbg) Run:  docker pull kicbase/echo-server:1.0
functional_test.go:347: (dbg) Run:  docker tag kicbase/echo-server:1.0 kicbase/echo-server:functional-137003
--- PASS: TestFunctional/parallel/ImageCommands/Setup (0.89s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (2.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-137003 /tmp/TestFunctionalparallelMountCmdVerifyCleanup173090664/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-137003 /tmp/TestFunctionalparallelMountCmdVerifyCleanup173090664/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-137003 /tmp/TestFunctionalparallelMountCmdVerifyCleanup173090664/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-137003 ssh "findmnt -T" /mount1: exit status 1 (735.287992ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
I1028 17:12:57.523312    7866 retry.go:31] will retry after 311.480515ms: exit status 1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-arm64 mount -p functional-137003 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-137003 /tmp/TestFunctionalparallelMountCmdVerifyCleanup173090664/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-137003 /tmp/TestFunctionalparallelMountCmdVerifyCleanup173090664/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-137003 /tmp/TestFunctionalparallelMountCmdVerifyCleanup173090664/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (2.13s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.6s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:355: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image load --daemon kicbase/echo-server:functional-137003 --alsologtostderr
functional_test.go:355: (dbg) Done: out/minikube-linux-arm64 -p functional-137003 image load --daemon kicbase/echo-server:functional-137003 --alsologtostderr: (1.261593992s)
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.60s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:365: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image load --daemon kicbase/echo-server:functional-137003 --alsologtostderr
functional_test.go:365: (dbg) Done: out/minikube-linux-arm64 -p functional-137003 image load --daemon kicbase/echo-server:functional-137003 --alsologtostderr: (1.065376587s)
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.70s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.77s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:235: (dbg) Run:  docker pull kicbase/echo-server:latest
functional_test.go:240: (dbg) Run:  docker tag kicbase/echo-server:latest kicbase/echo-server:functional-137003
functional_test.go:245: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image load --daemon kicbase/echo-server:functional-137003 --alsologtostderr
functional_test.go:245: (dbg) Done: out/minikube-linux-arm64 -p functional-137003 image load --daemon kicbase/echo-server:functional-137003 --alsologtostderr: (1.196550337s)
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.77s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2119: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2119: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.21s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2119: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.42s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:380: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image save kicbase/echo-server:functional-137003 /home/jenkins/workspace/Docker_Linux_containerd_arm64/echo-server-save.tar --alsologtostderr
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.42s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.58s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:392: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image rm kicbase/echo-server:functional-137003 --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.58s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.83s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:409: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image load /home/jenkins/workspace/Docker_Linux_containerd_arm64/echo-server-save.tar --alsologtostderr
functional_test.go:451: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.83s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:419: (dbg) Run:  docker rmi kicbase/echo-server:functional-137003
functional_test.go:424: (dbg) Run:  out/minikube-linux-arm64 -p functional-137003 image save --daemon kicbase/echo-server:functional-137003 --alsologtostderr
functional_test.go:432: (dbg) Run:  docker image inspect kicbase/echo-server:functional-137003
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.40s)

                                                
                                    
x
+
TestFunctional/delete_echo-server_images (0.04s)

                                                
                                                
=== RUN   TestFunctional/delete_echo-server_images
functional_test.go:190: (dbg) Run:  docker rmi -f kicbase/echo-server:1.0
functional_test.go:190: (dbg) Run:  docker rmi -f kicbase/echo-server:functional-137003
--- PASS: TestFunctional/delete_echo-server_images (0.04s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:198: (dbg) Run:  docker rmi -f localhost/my-image:functional-137003
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:206: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-137003
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StartCluster (133.45s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run:  out/minikube-linux-arm64 start -p ha-067233 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd
E1028 17:15:01.084301    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:101: (dbg) Done: out/minikube-linux-arm64 start -p ha-067233 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd: (2m12.574820286s)
ha_test.go:107: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 status -v=7 --alsologtostderr
--- PASS: TestMultiControlPlane/serial/StartCluster (133.45s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeployApp (35.97s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:133: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- rollout status deployment/busybox
E1028 17:15:28.789597    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:133: (dbg) Done: out/minikube-linux-arm64 kubectl -p ha-067233 -- rollout status deployment/busybox: (32.466525111s)
ha_test.go:140: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:163: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- exec busybox-7dff88458-drd28 -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- exec busybox-7dff88458-gkc9t -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- exec busybox-7dff88458-r82j9 -- nslookup kubernetes.io
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- exec busybox-7dff88458-drd28 -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- exec busybox-7dff88458-gkc9t -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- exec busybox-7dff88458-r82j9 -- nslookup kubernetes.default
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- exec busybox-7dff88458-drd28 -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- exec busybox-7dff88458-gkc9t -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- exec busybox-7dff88458-r82j9 -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiControlPlane/serial/DeployApp (35.97s)

                                                
                                    
x
+
TestMultiControlPlane/serial/PingHostFromPods (1.68s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- exec busybox-7dff88458-drd28 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- exec busybox-7dff88458-drd28 -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- exec busybox-7dff88458-gkc9t -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- exec busybox-7dff88458-gkc9t -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- exec busybox-7dff88458-r82j9 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-067233 -- exec busybox-7dff88458-r82j9 -- sh -c "ping -c 1 192.168.49.1"
--- PASS: TestMultiControlPlane/serial/PingHostFromPods (1.68s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddWorkerNode (22.6s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run:  out/minikube-linux-arm64 node add -p ha-067233 -v=7 --alsologtostderr
ha_test.go:228: (dbg) Done: out/minikube-linux-arm64 node add -p ha-067233 -v=7 --alsologtostderr: (21.563527122s)
ha_test.go:234: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 status -v=7 --alsologtostderr
ha_test.go:234: (dbg) Done: out/minikube-linux-arm64 -p ha-067233 status -v=7 --alsologtostderr: (1.034387988s)
--- PASS: TestMultiControlPlane/serial/AddWorkerNode (22.60s)

                                                
                                    
x
+
TestMultiControlPlane/serial/NodeLabels (0.12s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run:  kubectl --context ha-067233 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiControlPlane/serial/NodeLabels (0.12s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterClusterStart (1.03s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
ha_test.go:281: (dbg) Done: out/minikube-linux-arm64 profile list --output json: (1.03013963s)
--- PASS: TestMultiControlPlane/serial/HAppyAfterClusterStart (1.03s)

                                                
                                    
x
+
TestMultiControlPlane/serial/CopyFile (19.67s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/CopyFile
ha_test.go:328: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 status --output json -v=7 --alsologtostderr
ha_test.go:328: (dbg) Done: out/minikube-linux-arm64 -p ha-067233 status --output json -v=7 --alsologtostderr: (1.00251636s)
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp testdata/cp-test.txt ha-067233:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile66417274/001/cp-test_ha-067233.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233:/home/docker/cp-test.txt ha-067233-m02:/home/docker/cp-test_ha-067233_ha-067233-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m02 "sudo cat /home/docker/cp-test_ha-067233_ha-067233-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233:/home/docker/cp-test.txt ha-067233-m03:/home/docker/cp-test_ha-067233_ha-067233-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m03 "sudo cat /home/docker/cp-test_ha-067233_ha-067233-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233:/home/docker/cp-test.txt ha-067233-m04:/home/docker/cp-test_ha-067233_ha-067233-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m04 "sudo cat /home/docker/cp-test_ha-067233_ha-067233-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp testdata/cp-test.txt ha-067233-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233-m02:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile66417274/001/cp-test_ha-067233-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233-m02:/home/docker/cp-test.txt ha-067233:/home/docker/cp-test_ha-067233-m02_ha-067233.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233 "sudo cat /home/docker/cp-test_ha-067233-m02_ha-067233.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233-m02:/home/docker/cp-test.txt ha-067233-m03:/home/docker/cp-test_ha-067233-m02_ha-067233-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m03 "sudo cat /home/docker/cp-test_ha-067233-m02_ha-067233-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233-m02:/home/docker/cp-test.txt ha-067233-m04:/home/docker/cp-test_ha-067233-m02_ha-067233-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m04 "sudo cat /home/docker/cp-test_ha-067233-m02_ha-067233-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp testdata/cp-test.txt ha-067233-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233-m03:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile66417274/001/cp-test_ha-067233-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233-m03:/home/docker/cp-test.txt ha-067233:/home/docker/cp-test_ha-067233-m03_ha-067233.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233 "sudo cat /home/docker/cp-test_ha-067233-m03_ha-067233.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233-m03:/home/docker/cp-test.txt ha-067233-m02:/home/docker/cp-test_ha-067233-m03_ha-067233-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m02 "sudo cat /home/docker/cp-test_ha-067233-m03_ha-067233-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233-m03:/home/docker/cp-test.txt ha-067233-m04:/home/docker/cp-test_ha-067233-m03_ha-067233-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m04 "sudo cat /home/docker/cp-test_ha-067233-m03_ha-067233-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp testdata/cp-test.txt ha-067233-m04:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile66417274/001/cp-test_ha-067233-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233-m04:/home/docker/cp-test.txt ha-067233:/home/docker/cp-test_ha-067233-m04_ha-067233.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233 "sudo cat /home/docker/cp-test_ha-067233-m04_ha-067233.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233-m04:/home/docker/cp-test.txt ha-067233-m02:/home/docker/cp-test_ha-067233-m04_ha-067233-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m02 "sudo cat /home/docker/cp-test_ha-067233-m04_ha-067233-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 cp ha-067233-m04:/home/docker/cp-test.txt ha-067233-m03:/home/docker/cp-test_ha-067233-m04_ha-067233-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 ssh -n ha-067233-m03 "sudo cat /home/docker/cp-test_ha-067233-m04_ha-067233-m03.txt"
--- PASS: TestMultiControlPlane/serial/CopyFile (19.67s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopSecondaryNode (12.9s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopSecondaryNode
ha_test.go:365: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 node stop m02 -v=7 --alsologtostderr
ha_test.go:365: (dbg) Done: out/minikube-linux-arm64 -p ha-067233 node stop m02 -v=7 --alsologtostderr: (12.1619747s)
ha_test.go:371: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 status -v=7 --alsologtostderr
ha_test.go:371: (dbg) Non-zero exit: out/minikube-linux-arm64 -p ha-067233 status -v=7 --alsologtostderr: exit status 7 (735.469867ms)

                                                
                                                
-- stdout --
	ha-067233
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-067233-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-067233-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-067233-m04
	type: Worker
	host: Running
	kubelet: Running
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 17:16:58.472478   63697 out.go:345] Setting OutFile to fd 1 ...
	I1028 17:16:58.472776   63697 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:16:58.472806   63697 out.go:358] Setting ErrFile to fd 2...
	I1028 17:16:58.472830   63697 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:16:58.473097   63697 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
	I1028 17:16:58.473333   63697 out.go:352] Setting JSON to false
	I1028 17:16:58.473390   63697 mustload.go:65] Loading cluster: ha-067233
	I1028 17:16:58.473462   63697 notify.go:220] Checking for updates...
	I1028 17:16:58.473862   63697 config.go:182] Loaded profile config "ha-067233": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
	I1028 17:16:58.473900   63697 status.go:174] checking status of ha-067233 ...
	I1028 17:16:58.474433   63697 cli_runner.go:164] Run: docker container inspect ha-067233 --format={{.State.Status}}
	I1028 17:16:58.493400   63697 status.go:371] ha-067233 host status = "Running" (err=<nil>)
	I1028 17:16:58.493429   63697 host.go:66] Checking if "ha-067233" exists ...
	I1028 17:16:58.493736   63697 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-067233
	I1028 17:16:58.515421   63697 host.go:66] Checking if "ha-067233" exists ...
	I1028 17:16:58.515789   63697 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I1028 17:16:58.515870   63697 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-067233
	I1028 17:16:58.536245   63697 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/ha-067233/id_rsa Username:docker}
	I1028 17:16:58.633787   63697 ssh_runner.go:195] Run: systemctl --version
	I1028 17:16:58.638366   63697 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1028 17:16:58.650005   63697 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1028 17:16:58.710270   63697 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:55 OomKillDisable:true NGoroutines:71 SystemTime:2024-10-28 17:16:58.700265916 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I1028 17:16:58.710856   63697 kubeconfig.go:125] found "ha-067233" server: "https://192.168.49.254:8443"
	I1028 17:16:58.710888   63697 api_server.go:166] Checking apiserver status ...
	I1028 17:16:58.710941   63697 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 17:16:58.723520   63697 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1450/cgroup
	I1028 17:16:58.733584   63697 api_server.go:182] apiserver freezer: "13:freezer:/docker/0c1ef7b6669fade5af568270d92d1538b9cf4fc2efc177f0638920347b2866e1/kubepods/burstable/podf6bda0b0b89f3846488e339560f22b56/f7c744245aa3babbc300f36fdbda375d6663ec007c39249458923a61998c0aae"
	I1028 17:16:58.733659   63697 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/0c1ef7b6669fade5af568270d92d1538b9cf4fc2efc177f0638920347b2866e1/kubepods/burstable/podf6bda0b0b89f3846488e339560f22b56/f7c744245aa3babbc300f36fdbda375d6663ec007c39249458923a61998c0aae/freezer.state
	I1028 17:16:58.742881   63697 api_server.go:204] freezer state: "THAWED"
	I1028 17:16:58.742916   63697 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I1028 17:16:58.752310   63697 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I1028 17:16:58.752351   63697 status.go:463] ha-067233 apiserver status = Running (err=<nil>)
	I1028 17:16:58.752362   63697 status.go:176] ha-067233 status: &{Name:ha-067233 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I1028 17:16:58.752385   63697 status.go:174] checking status of ha-067233-m02 ...
	I1028 17:16:58.752741   63697 cli_runner.go:164] Run: docker container inspect ha-067233-m02 --format={{.State.Status}}
	I1028 17:16:58.769849   63697 status.go:371] ha-067233-m02 host status = "Stopped" (err=<nil>)
	I1028 17:16:58.769873   63697 status.go:384] host is not running, skipping remaining checks
	I1028 17:16:58.769881   63697 status.go:176] ha-067233-m02 status: &{Name:ha-067233-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I1028 17:16:58.769921   63697 status.go:174] checking status of ha-067233-m03 ...
	I1028 17:16:58.770228   63697 cli_runner.go:164] Run: docker container inspect ha-067233-m03 --format={{.State.Status}}
	I1028 17:16:58.787753   63697 status.go:371] ha-067233-m03 host status = "Running" (err=<nil>)
	I1028 17:16:58.787798   63697 host.go:66] Checking if "ha-067233-m03" exists ...
	I1028 17:16:58.788077   63697 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-067233-m03
	I1028 17:16:58.806052   63697 host.go:66] Checking if "ha-067233-m03" exists ...
	I1028 17:16:58.806368   63697 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I1028 17:16:58.806410   63697 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-067233-m03
	I1028 17:16:58.824008   63697 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32798 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/ha-067233-m03/id_rsa Username:docker}
	I1028 17:16:58.921816   63697 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1028 17:16:58.937074   63697 kubeconfig.go:125] found "ha-067233" server: "https://192.168.49.254:8443"
	I1028 17:16:58.937104   63697 api_server.go:166] Checking apiserver status ...
	I1028 17:16:58.937144   63697 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 17:16:58.950027   63697 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1324/cgroup
	I1028 17:16:58.961269   63697 api_server.go:182] apiserver freezer: "13:freezer:/docker/a882081c45a46cdebd9e3a6426219f9879a7063bfdc40b072bf065b53b1c2811/kubepods/burstable/podf76fddec7b880701c7be198478ab54d5/d9a991e00583d21cbd5c8a4d9d802d6cbc7a2134d82edf7d7006b1fdb00e45b0"
	I1028 17:16:58.961344   63697 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/a882081c45a46cdebd9e3a6426219f9879a7063bfdc40b072bf065b53b1c2811/kubepods/burstable/podf76fddec7b880701c7be198478ab54d5/d9a991e00583d21cbd5c8a4d9d802d6cbc7a2134d82edf7d7006b1fdb00e45b0/freezer.state
	I1028 17:16:58.970254   63697 api_server.go:204] freezer state: "THAWED"
	I1028 17:16:58.970282   63697 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I1028 17:16:58.978289   63697 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I1028 17:16:58.978315   63697 status.go:463] ha-067233-m03 apiserver status = Running (err=<nil>)
	I1028 17:16:58.978333   63697 status.go:176] ha-067233-m03 status: &{Name:ha-067233-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I1028 17:16:58.978351   63697 status.go:174] checking status of ha-067233-m04 ...
	I1028 17:16:58.978665   63697 cli_runner.go:164] Run: docker container inspect ha-067233-m04 --format={{.State.Status}}
	I1028 17:16:58.996673   63697 status.go:371] ha-067233-m04 host status = "Running" (err=<nil>)
	I1028 17:16:58.996699   63697 host.go:66] Checking if "ha-067233-m04" exists ...
	I1028 17:16:58.997004   63697 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-067233-m04
	I1028 17:16:59.015619   63697 host.go:66] Checking if "ha-067233-m04" exists ...
	I1028 17:16:59.015953   63697 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I1028 17:16:59.016000   63697 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-067233-m04
	I1028 17:16:59.035824   63697 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32803 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/ha-067233-m04/id_rsa Username:docker}
	I1028 17:16:59.134115   63697 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1028 17:16:59.146304   63697 status.go:176] ha-067233-m04 status: &{Name:ha-067233-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopSecondaryNode (12.90s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.81s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:392: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.81s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartSecondaryNode (19.81s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode
ha_test.go:422: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 node start m02 -v=7 --alsologtostderr
E1028 17:17:15.750821    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:17:15.757538    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:17:15.769011    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:17:15.790502    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:17:15.831911    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:17:15.913636    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:17:16.075584    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:17:16.399292    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:17:17.041272    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:17:18.322630    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:422: (dbg) Done: out/minikube-linux-arm64 -p ha-067233 node start m02 -v=7 --alsologtostderr: (18.724810507s)
ha_test.go:430: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 status -v=7 --alsologtostderr
ha_test.go:450: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiControlPlane/serial/RestartSecondaryNode (19.81s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (1s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
ha_test.go:281: (dbg) Done: out/minikube-linux-arm64 profile list --output json: (1.002925755s)
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (1.00s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartClusterKeepsNodes (139.56s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:458: (dbg) Run:  out/minikube-linux-arm64 node list -p ha-067233 -v=7 --alsologtostderr
ha_test.go:464: (dbg) Run:  out/minikube-linux-arm64 stop -p ha-067233 -v=7 --alsologtostderr
E1028 17:17:20.884715    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:17:26.006794    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:17:36.248958    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:464: (dbg) Done: out/minikube-linux-arm64 stop -p ha-067233 -v=7 --alsologtostderr: (26.401460757s)
ha_test.go:469: (dbg) Run:  out/minikube-linux-arm64 start -p ha-067233 --wait=true -v=7 --alsologtostderr
E1028 17:17:56.731091    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:18:37.692446    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:469: (dbg) Done: out/minikube-linux-arm64 start -p ha-067233 --wait=true -v=7 --alsologtostderr: (1m52.982862297s)
ha_test.go:474: (dbg) Run:  out/minikube-linux-arm64 node list -p ha-067233
--- PASS: TestMultiControlPlane/serial/RestartClusterKeepsNodes (139.56s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeleteSecondaryNode (11.19s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode
ha_test.go:489: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 node delete m03 -v=7 --alsologtostderr
ha_test.go:489: (dbg) Done: out/minikube-linux-arm64 -p ha-067233 node delete m03 -v=7 --alsologtostderr: (10.226222133s)
ha_test.go:495: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 status -v=7 --alsologtostderr
ha_test.go:513: (dbg) Run:  kubectl get nodes
ha_test.go:521: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/DeleteSecondaryNode (11.19s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.76s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:392: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.76s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopCluster (36.18s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopCluster
ha_test.go:533: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 stop -v=7 --alsologtostderr
E1028 17:19:59.616717    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:20:01.084753    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:533: (dbg) Done: out/minikube-linux-arm64 -p ha-067233 stop -v=7 --alsologtostderr: (36.071855499s)
ha_test.go:539: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 status -v=7 --alsologtostderr
ha_test.go:539: (dbg) Non-zero exit: out/minikube-linux-arm64 -p ha-067233 status -v=7 --alsologtostderr: exit status 7 (106.687506ms)

                                                
                                                
-- stdout --
	ha-067233
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-067233-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-067233-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 17:20:28.398208   77554 out.go:345] Setting OutFile to fd 1 ...
	I1028 17:20:28.398393   77554 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:20:28.398423   77554 out.go:358] Setting ErrFile to fd 2...
	I1028 17:20:28.398446   77554 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:20:28.398721   77554 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
	I1028 17:20:28.398943   77554 out.go:352] Setting JSON to false
	I1028 17:20:28.398994   77554 mustload.go:65] Loading cluster: ha-067233
	I1028 17:20:28.399111   77554 notify.go:220] Checking for updates...
	I1028 17:20:28.399476   77554 config.go:182] Loaded profile config "ha-067233": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
	I1028 17:20:28.399521   77554 status.go:174] checking status of ha-067233 ...
	I1028 17:20:28.400153   77554 cli_runner.go:164] Run: docker container inspect ha-067233 --format={{.State.Status}}
	I1028 17:20:28.418281   77554 status.go:371] ha-067233 host status = "Stopped" (err=<nil>)
	I1028 17:20:28.418307   77554 status.go:384] host is not running, skipping remaining checks
	I1028 17:20:28.418314   77554 status.go:176] ha-067233 status: &{Name:ha-067233 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I1028 17:20:28.418353   77554 status.go:174] checking status of ha-067233-m02 ...
	I1028 17:20:28.418659   77554 cli_runner.go:164] Run: docker container inspect ha-067233-m02 --format={{.State.Status}}
	I1028 17:20:28.438489   77554 status.go:371] ha-067233-m02 host status = "Stopped" (err=<nil>)
	I1028 17:20:28.438514   77554 status.go:384] host is not running, skipping remaining checks
	I1028 17:20:28.438521   77554 status.go:176] ha-067233-m02 status: &{Name:ha-067233-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I1028 17:20:28.438540   77554 status.go:174] checking status of ha-067233-m04 ...
	I1028 17:20:28.438833   77554 cli_runner.go:164] Run: docker container inspect ha-067233-m04 --format={{.State.Status}}
	I1028 17:20:28.453309   77554 status.go:371] ha-067233-m04 host status = "Stopped" (err=<nil>)
	I1028 17:20:28.453334   77554 status.go:384] host is not running, skipping remaining checks
	I1028 17:20:28.453341   77554 status.go:176] ha-067233-m04 status: &{Name:ha-067233-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopCluster (36.18s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartCluster (77.93s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartCluster
ha_test.go:562: (dbg) Run:  out/minikube-linux-arm64 start -p ha-067233 --wait=true -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd
ha_test.go:562: (dbg) Done: out/minikube-linux-arm64 start -p ha-067233 --wait=true -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m16.955618096s)
ha_test.go:568: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 status -v=7 --alsologtostderr
ha_test.go:586: (dbg) Run:  kubectl get nodes
ha_test.go:594: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/RestartCluster (77.93s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.78s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:392: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.78s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddSecondaryNode (42.76s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddSecondaryNode
ha_test.go:607: (dbg) Run:  out/minikube-linux-arm64 node add -p ha-067233 --control-plane -v=7 --alsologtostderr
E1028 17:22:15.750945    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:607: (dbg) Done: out/minikube-linux-arm64 node add -p ha-067233 --control-plane -v=7 --alsologtostderr: (41.724373829s)
ha_test.go:613: (dbg) Run:  out/minikube-linux-arm64 -p ha-067233 status -v=7 --alsologtostderr
ha_test.go:613: (dbg) Done: out/minikube-linux-arm64 -p ha-067233 status -v=7 --alsologtostderr: (1.033858402s)
--- PASS: TestMultiControlPlane/serial/AddSecondaryNode (42.76s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (1.11s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
ha_test.go:281: (dbg) Done: out/minikube-linux-arm64 profile list --output json: (1.109627487s)
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (1.11s)

                                                
                                    
x
+
TestJSONOutput/start/Command (90.99s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-535831 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd
E1028 17:22:43.458423    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 start -p json-output-535831 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd: (1m30.985107688s)
--- PASS: TestJSONOutput/start/Command (90.99s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.75s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 pause -p json-output-535831 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.75s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.68s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 unpause -p json-output-535831 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.68s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.82s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 stop -p json-output-535831 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 stop -p json-output-535831 --output=json --user=testUser: (5.823483615s)
--- PASS: TestJSONOutput/stop/Command (5.82s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.24s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-error-915049 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p json-output-error-915049 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (92.460034ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"ad1038b2-32f8-458d-aed0-10e8ca2dc7f0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-915049] minikube v1.34.0 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"e91d11ac-a13a-416c-8945-421de2330577","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19872"}}
	{"specversion":"1.0","id":"f0cefdca-4ce1-48de-9161-c1f494f0eb6c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"225fe4f4-f341-4fd5-9548-6d51eb5f4e42","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig"}}
	{"specversion":"1.0","id":"d33c5de5-986f-4178-a8e4-7dfcd26bf1bc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube"}}
	{"specversion":"1.0","id":"66ce030f-dfe1-406a-8e78-4e8650ed55f0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"119a7b42-4d24-4664-859b-364e06dc1f31","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"50016fd8-0dc6-48d9-8a25-6bc6fefe0eb0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-915049" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p json-output-error-915049
--- PASS: TestErrorJSONOutput (0.24s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (38.7s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-768646 --network=
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-768646 --network=: (36.122422718s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-768646" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-768646
E1028 17:25:01.084831    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-768646: (2.557214142s)
--- PASS: TestKicCustomNetwork/create_custom_network (38.70s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (31.28s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-607077 --network=bridge
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-607077 --network=bridge: (29.229831147s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-607077" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-607077
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-607077: (2.028653818s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (31.28s)

                                                
                                    
x
+
TestKicExistingNetwork (31.15s)

                                                
                                                
=== RUN   TestKicExistingNetwork
I1028 17:25:32.435558    7866 cli_runner.go:164] Run: docker network inspect existing-network --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1028 17:25:32.450813    7866 cli_runner.go:211] docker network inspect existing-network --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1028 17:25:32.450900    7866 network_create.go:284] running [docker network inspect existing-network] to gather additional debugging logs...
I1028 17:25:32.450921    7866 cli_runner.go:164] Run: docker network inspect existing-network
W1028 17:25:32.465280    7866 cli_runner.go:211] docker network inspect existing-network returned with exit code 1
I1028 17:25:32.465313    7866 network_create.go:287] error running [docker network inspect existing-network]: docker network inspect existing-network: exit status 1
stdout:
[]

                                                
                                                
stderr:
Error response from daemon: network existing-network not found
I1028 17:25:32.465327    7866 network_create.go:289] output of [docker network inspect existing-network]: -- stdout --
[]

                                                
                                                
-- /stdout --
** stderr ** 
Error response from daemon: network existing-network not found

                                                
                                                
** /stderr **
I1028 17:25:32.465535    7866 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1028 17:25:32.481224    7866 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-fb6396425b14 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:9c:65:6c:a3} reservation:<nil>}
I1028 17:25:32.481537    7866 network.go:206] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x400132b780}
I1028 17:25:32.481566    7866 network_create.go:124] attempt to create docker network existing-network 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I1028 17:25:32.481614    7866 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=existing-network existing-network
I1028 17:25:32.552741    7866 network_create.go:108] docker network existing-network 192.168.58.0/24 created
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-arm64 start -p existing-network-764147 --network=existing-network
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-arm64 start -p existing-network-764147 --network=existing-network: (28.962780785s)
helpers_test.go:175: Cleaning up "existing-network-764147" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p existing-network-764147
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p existing-network-764147: (2.037427497s)
I1028 17:26:03.569471    7866 cli_runner.go:164] Run: docker network ls --filter=label=existing-network --format {{.Name}}
--- PASS: TestKicExistingNetwork (31.15s)

                                                
                                    
x
+
TestKicCustomSubnet (36.8s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-subnet-153273 --subnet=192.168.60.0/24
E1028 17:26:24.151886    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-subnet-153273 --subnet=192.168.60.0/24: (34.638615897s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-153273 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-153273" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p custom-subnet-153273
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p custom-subnet-153273: (2.1359848s)
--- PASS: TestKicCustomSubnet (36.80s)

                                                
                                    
x
+
TestKicStaticIP (34.51s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-arm64 start -p static-ip-761797 --static-ip=192.168.200.200
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-arm64 start -p static-ip-761797 --static-ip=192.168.200.200: (32.273189322s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-arm64 -p static-ip-761797 ip
helpers_test.go:175: Cleaning up "static-ip-761797" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p static-ip-761797
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p static-ip-761797: (2.074581909s)
--- PASS: TestKicStaticIP (34.51s)

                                                
                                    
x
+
TestMainNoArgs (0.06s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-arm64
--- PASS: TestMainNoArgs (0.06s)

                                                
                                    
x
+
TestMinikubeProfile (65.85s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p first-255573 --driver=docker  --container-runtime=containerd
E1028 17:27:15.751365    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p first-255573 --driver=docker  --container-runtime=containerd: (30.932801135s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p second-258650 --driver=docker  --container-runtime=containerd
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p second-258650 --driver=docker  --container-runtime=containerd: (29.651341103s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile first-255573
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile second-258650
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
helpers_test.go:175: Cleaning up "second-258650" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p second-258650
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p second-258650: (2.0028972s)
helpers_test.go:175: Cleaning up "first-255573" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p first-255573
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p first-255573: (1.961649392s)
--- PASS: TestMinikubeProfile (65.85s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (6.8s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-1-918981 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-1-918981 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (5.796051954s)
--- PASS: TestMountStart/serial/StartWithMountFirst (6.80s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.28s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-1-918981 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.28s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (5.93s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-921156 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-921156 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (4.934604516s)
--- PASS: TestMountStart/serial/StartWithMountSecond (5.93s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.26s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-921156 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.26s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.6s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p mount-start-1-918981 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p mount-start-1-918981 --alsologtostderr -v=5: (1.60376173s)
--- PASS: TestMountStart/serial/DeleteFirst (1.60s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.26s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-921156 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.26s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.2s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-arm64 stop -p mount-start-2-921156
mount_start_test.go:155: (dbg) Done: out/minikube-linux-arm64 stop -p mount-start-2-921156: (1.204632379s)
--- PASS: TestMountStart/serial/Stop (1.20s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (8.22s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-921156
mount_start_test.go:166: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-921156: (7.216217159s)
--- PASS: TestMountStart/serial/RestartStopped (8.22s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.28s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-921156 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.28s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (66.75s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-558472 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
multinode_test.go:96: (dbg) Done: out/minikube-linux-arm64 start -p multinode-558472 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m6.228905378s)
multinode_test.go:102: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (66.75s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (16.48s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-558472 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:498: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-558472 -- rollout status deployment/busybox
E1028 17:30:01.084532    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
multinode_test.go:498: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-558472 -- rollout status deployment/busybox: (14.515803394s)
multinode_test.go:505: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-558472 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:528: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-558472 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:536: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-558472 -- exec busybox-7dff88458-66hwv -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-558472 -- exec busybox-7dff88458-gx98v -- nslookup kubernetes.io
multinode_test.go:546: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-558472 -- exec busybox-7dff88458-66hwv -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-558472 -- exec busybox-7dff88458-gx98v -- nslookup kubernetes.default
multinode_test.go:554: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-558472 -- exec busybox-7dff88458-66hwv -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-558472 -- exec busybox-7dff88458-gx98v -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (16.48s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (1.03s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-558472 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:572: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-558472 -- exec busybox-7dff88458-66hwv -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-558472 -- exec busybox-7dff88458-66hwv -- sh -c "ping -c 1 192.168.67.1"
multinode_test.go:572: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-558472 -- exec busybox-7dff88458-gx98v -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-558472 -- exec busybox-7dff88458-gx98v -- sh -c "ping -c 1 192.168.67.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (1.03s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (17.32s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-558472 -v 3 --alsologtostderr
multinode_test.go:121: (dbg) Done: out/minikube-linux-arm64 node add -p multinode-558472 -v 3 --alsologtostderr: (16.64534877s)
multinode_test.go:127: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (17.32s)

                                                
                                    
x
+
TestMultiNode/serial/MultiNodeLabels (0.09s)

                                                
                                                
=== RUN   TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run:  kubectl --context multinode-558472 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiNode/serial/MultiNodeLabels (0.09s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.69s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.69s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (10.47s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 cp testdata/cp-test.txt multinode-558472:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 cp multinode-558472:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile702450234/001/cp-test_multinode-558472.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 cp multinode-558472:/home/docker/cp-test.txt multinode-558472-m02:/home/docker/cp-test_multinode-558472_multinode-558472-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472-m02 "sudo cat /home/docker/cp-test_multinode-558472_multinode-558472-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 cp multinode-558472:/home/docker/cp-test.txt multinode-558472-m03:/home/docker/cp-test_multinode-558472_multinode-558472-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472-m03 "sudo cat /home/docker/cp-test_multinode-558472_multinode-558472-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 cp testdata/cp-test.txt multinode-558472-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 cp multinode-558472-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile702450234/001/cp-test_multinode-558472-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 cp multinode-558472-m02:/home/docker/cp-test.txt multinode-558472:/home/docker/cp-test_multinode-558472-m02_multinode-558472.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472 "sudo cat /home/docker/cp-test_multinode-558472-m02_multinode-558472.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 cp multinode-558472-m02:/home/docker/cp-test.txt multinode-558472-m03:/home/docker/cp-test_multinode-558472-m02_multinode-558472-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472-m03 "sudo cat /home/docker/cp-test_multinode-558472-m02_multinode-558472-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 cp testdata/cp-test.txt multinode-558472-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 cp multinode-558472-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile702450234/001/cp-test_multinode-558472-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 cp multinode-558472-m03:/home/docker/cp-test.txt multinode-558472:/home/docker/cp-test_multinode-558472-m03_multinode-558472.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472 "sudo cat /home/docker/cp-test_multinode-558472-m03_multinode-558472.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 cp multinode-558472-m03:/home/docker/cp-test.txt multinode-558472-m02:/home/docker/cp-test_multinode-558472-m03_multinode-558472-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 ssh -n multinode-558472-m02 "sudo cat /home/docker/cp-test_multinode-558472-m03_multinode-558472-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (10.47s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.33s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 node stop m03
multinode_test.go:248: (dbg) Done: out/minikube-linux-arm64 -p multinode-558472 node stop m03: (1.220527192s)
multinode_test.go:254: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-558472 status: exit status 7 (522.052628ms)

                                                
                                                
-- stdout --
	multinode-558472
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-558472-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-558472-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-558472 status --alsologtostderr: exit status 7 (589.841496ms)

                                                
                                                
-- stdout --
	multinode-558472
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-558472-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-558472-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 17:30:42.038311  130849 out.go:345] Setting OutFile to fd 1 ...
	I1028 17:30:42.038452  130849 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:30:42.038471  130849 out.go:358] Setting ErrFile to fd 2...
	I1028 17:30:42.038477  130849 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:30:42.038838  130849 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
	I1028 17:30:42.039085  130849 out.go:352] Setting JSON to false
	I1028 17:30:42.039113  130849 mustload.go:65] Loading cluster: multinode-558472
	I1028 17:30:42.039853  130849 config.go:182] Loaded profile config "multinode-558472": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
	I1028 17:30:42.039884  130849 status.go:174] checking status of multinode-558472 ...
	I1028 17:30:42.040890  130849 cli_runner.go:164] Run: docker container inspect multinode-558472 --format={{.State.Status}}
	I1028 17:30:42.040911  130849 notify.go:220] Checking for updates...
	I1028 17:30:42.059413  130849 status.go:371] multinode-558472 host status = "Running" (err=<nil>)
	I1028 17:30:42.059439  130849 host.go:66] Checking if "multinode-558472" exists ...
	I1028 17:30:42.059749  130849 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-558472
	I1028 17:30:42.093384  130849 host.go:66] Checking if "multinode-558472" exists ...
	I1028 17:30:42.093814  130849 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I1028 17:30:42.093889  130849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-558472
	I1028 17:30:42.118719  130849 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32908 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/multinode-558472/id_rsa Username:docker}
	I1028 17:30:42.243063  130849 ssh_runner.go:195] Run: systemctl --version
	I1028 17:30:42.261401  130849 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1028 17:30:42.275518  130849 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1028 17:30:42.338809  130849 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:41 OomKillDisable:true NGoroutines:61 SystemTime:2024-10-28 17:30:42.32824817 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aa
rch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge-
nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I1028 17:30:42.339571  130849 kubeconfig.go:125] found "multinode-558472" server: "https://192.168.67.2:8443"
	I1028 17:30:42.339606  130849 api_server.go:166] Checking apiserver status ...
	I1028 17:30:42.339655  130849 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I1028 17:30:42.351830  130849 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1385/cgroup
	I1028 17:30:42.362498  130849 api_server.go:182] apiserver freezer: "13:freezer:/docker/9ac66e78f2e2580194d8c0be23ac17b383e6d174b87fe4f0046f207a9913551e/kubepods/burstable/podeca74b2dc2730276d4ce5b0792caa867/804b2645c069b3d5fbd2013cfcc7327eb482a1549547ec563ae4721c85f08708"
	I1028 17:30:42.362575  130849 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/9ac66e78f2e2580194d8c0be23ac17b383e6d174b87fe4f0046f207a9913551e/kubepods/burstable/podeca74b2dc2730276d4ce5b0792caa867/804b2645c069b3d5fbd2013cfcc7327eb482a1549547ec563ae4721c85f08708/freezer.state
	I1028 17:30:42.371883  130849 api_server.go:204] freezer state: "THAWED"
	I1028 17:30:42.371914  130849 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I1028 17:30:42.379873  130849 api_server.go:279] https://192.168.67.2:8443/healthz returned 200:
	ok
	I1028 17:30:42.379904  130849 status.go:463] multinode-558472 apiserver status = Running (err=<nil>)
	I1028 17:30:42.379915  130849 status.go:176] multinode-558472 status: &{Name:multinode-558472 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I1028 17:30:42.379962  130849 status.go:174] checking status of multinode-558472-m02 ...
	I1028 17:30:42.380286  130849 cli_runner.go:164] Run: docker container inspect multinode-558472-m02 --format={{.State.Status}}
	I1028 17:30:42.397410  130849 status.go:371] multinode-558472-m02 host status = "Running" (err=<nil>)
	I1028 17:30:42.397438  130849 host.go:66] Checking if "multinode-558472-m02" exists ...
	I1028 17:30:42.397748  130849 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-558472-m02
	I1028 17:30:42.414135  130849 host.go:66] Checking if "multinode-558472-m02" exists ...
	I1028 17:30:42.414437  130849 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I1028 17:30:42.414489  130849 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-558472-m02
	I1028 17:30:42.431946  130849 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32913 SSHKeyPath:/home/jenkins/minikube-integration/19872-2421/.minikube/machines/multinode-558472-m02/id_rsa Username:docker}
	I1028 17:30:42.529907  130849 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I1028 17:30:42.541575  130849 status.go:176] multinode-558472-m02 status: &{Name:multinode-558472-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I1028 17:30:42.541608  130849 status.go:174] checking status of multinode-558472-m03 ...
	I1028 17:30:42.541916  130849 cli_runner.go:164] Run: docker container inspect multinode-558472-m03 --format={{.State.Status}}
	I1028 17:30:42.563810  130849 status.go:371] multinode-558472-m03 host status = "Stopped" (err=<nil>)
	I1028 17:30:42.563833  130849 status.go:384] host is not running, skipping remaining checks
	I1028 17:30:42.563840  130849 status.go:176] multinode-558472-m03 status: &{Name:multinode-558472-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.33s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (9.45s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 node start m03 -v=7 --alsologtostderr
multinode_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p multinode-558472 node start m03 -v=7 --alsologtostderr: (8.617548168s)
multinode_test.go:290: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 status -v=7 --alsologtostderr
multinode_test.go:306: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (9.45s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (92.56s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-558472
multinode_test.go:321: (dbg) Run:  out/minikube-linux-arm64 stop -p multinode-558472
multinode_test.go:321: (dbg) Done: out/minikube-linux-arm64 stop -p multinode-558472: (25.018876397s)
multinode_test.go:326: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-558472 --wait=true -v=8 --alsologtostderr
E1028 17:32:15.751790    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
multinode_test.go:326: (dbg) Done: out/minikube-linux-arm64 start -p multinode-558472 --wait=true -v=8 --alsologtostderr: (1m7.409982926s)
multinode_test.go:331: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-558472
--- PASS: TestMultiNode/serial/RestartKeepsNodes (92.56s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.62s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 node delete m03
multinode_test.go:416: (dbg) Done: out/minikube-linux-arm64 -p multinode-558472 node delete m03: (4.880984846s)
multinode_test.go:422: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 status --alsologtostderr
multinode_test.go:436: (dbg) Run:  kubectl get nodes
multinode_test.go:444: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.62s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (24.05s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 stop
multinode_test.go:345: (dbg) Done: out/minikube-linux-arm64 -p multinode-558472 stop: (23.862385694s)
multinode_test.go:351: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-558472 status: exit status 7 (96.333253ms)

                                                
                                                
-- stdout --
	multinode-558472
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-558472-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:358: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-558472 status --alsologtostderr: exit status 7 (87.2878ms)

                                                
                                                
-- stdout --
	multinode-558472
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-558472-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 17:32:54.201313  139325 out.go:345] Setting OutFile to fd 1 ...
	I1028 17:32:54.201505  139325 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:32:54.201532  139325 out.go:358] Setting ErrFile to fd 2...
	I1028 17:32:54.201553  139325 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:32:54.201953  139325 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
	I1028 17:32:54.202247  139325 out.go:352] Setting JSON to false
	I1028 17:32:54.202315  139325 mustload.go:65] Loading cluster: multinode-558472
	I1028 17:32:54.202994  139325 notify.go:220] Checking for updates...
	I1028 17:32:54.203321  139325 config.go:182] Loaded profile config "multinode-558472": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
	I1028 17:32:54.203357  139325 status.go:174] checking status of multinode-558472 ...
	I1028 17:32:54.203924  139325 cli_runner.go:164] Run: docker container inspect multinode-558472 --format={{.State.Status}}
	I1028 17:32:54.220831  139325 status.go:371] multinode-558472 host status = "Stopped" (err=<nil>)
	I1028 17:32:54.220853  139325 status.go:384] host is not running, skipping remaining checks
	I1028 17:32:54.220861  139325 status.go:176] multinode-558472 status: &{Name:multinode-558472 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I1028 17:32:54.220895  139325 status.go:174] checking status of multinode-558472-m02 ...
	I1028 17:32:54.221279  139325 cli_runner.go:164] Run: docker container inspect multinode-558472-m02 --format={{.State.Status}}
	I1028 17:32:54.237219  139325 status.go:371] multinode-558472-m02 host status = "Stopped" (err=<nil>)
	I1028 17:32:54.237244  139325 status.go:384] host is not running, skipping remaining checks
	I1028 17:32:54.237252  139325 status.go:176] multinode-558472-m02 status: &{Name:multinode-558472-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (24.05s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (60.33s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-558472 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
E1028 17:33:38.820914    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
multinode_test.go:376: (dbg) Done: out/minikube-linux-arm64 start -p multinode-558472 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (59.592761796s)
multinode_test.go:382: (dbg) Run:  out/minikube-linux-arm64 -p multinode-558472 status --alsologtostderr
multinode_test.go:396: (dbg) Run:  kubectl get nodes
multinode_test.go:404: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (60.33s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (36.03s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-558472
multinode_test.go:464: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-558472-m02 --driver=docker  --container-runtime=containerd
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p multinode-558472-m02 --driver=docker  --container-runtime=containerd: exit status 14 (100.634164ms)

                                                
                                                
-- stdout --
	* [multinode-558472-m02] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19872
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-558472-m02' is duplicated with machine name 'multinode-558472-m02' in profile 'multinode-558472'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-558472-m03 --driver=docker  --container-runtime=containerd
multinode_test.go:472: (dbg) Done: out/minikube-linux-arm64 start -p multinode-558472-m03 --driver=docker  --container-runtime=containerd: (33.501867791s)
multinode_test.go:479: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-558472
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-linux-arm64 node add -p multinode-558472: exit status 80 (321.502848ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-558472 as [worker]
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-558472-m03 already exists in multinode-558472-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:484: (dbg) Run:  out/minikube-linux-arm64 delete -p multinode-558472-m03
multinode_test.go:484: (dbg) Done: out/minikube-linux-arm64 delete -p multinode-558472-m03: (2.053232172s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (36.03s)

                                                
                                    
x
+
TestPreload (125.53s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-320720 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4
E1028 17:35:01.084876    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
preload_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-320720 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4: (1m26.446294361s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-320720 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-arm64 -p test-preload-320720 image pull gcr.io/k8s-minikube/busybox: (2.217005076s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-arm64 stop -p test-preload-320720
preload_test.go:58: (dbg) Done: out/minikube-linux-arm64 stop -p test-preload-320720: (12.105147813s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-320720 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd
preload_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-320720 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd: (21.864045533s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-320720 image list
helpers_test.go:175: Cleaning up "test-preload-320720" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p test-preload-320720
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p test-preload-320720: (2.538271835s)
--- PASS: TestPreload (125.53s)

                                                
                                    
x
+
TestScheduledStopUnix (107.51s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-arm64 start -p scheduled-stop-230245 --memory=2048 --driver=docker  --container-runtime=containerd
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-230245 --memory=2048 --driver=docker  --container-runtime=containerd: (30.758967548s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-230245 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-230245 -n scheduled-stop-230245
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-230245 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
I1028 17:37:11.361583    7866 retry.go:31] will retry after 122.915µs: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.362048    7866 retry.go:31] will retry after 160.364µs: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.363170    7866 retry.go:31] will retry after 117.675µs: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.364289    7866 retry.go:31] will retry after 379.224µs: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.365409    7866 retry.go:31] will retry after 690.749µs: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.366534    7866 retry.go:31] will retry after 791.296µs: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.367661    7866 retry.go:31] will retry after 1.144863ms: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.369854    7866 retry.go:31] will retry after 1.277524ms: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.372048    7866 retry.go:31] will retry after 3.257642ms: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.376271    7866 retry.go:31] will retry after 2.50976ms: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.379409    7866 retry.go:31] will retry after 7.906861ms: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.387640    7866 retry.go:31] will retry after 11.503219ms: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.400135    7866 retry.go:31] will retry after 16.362824ms: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.417365    7866 retry.go:31] will retry after 14.924975ms: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.432627    7866 retry.go:31] will retry after 19.413106ms: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.452853    7866 retry.go:31] will retry after 25.874706ms: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
I1028 17:37:11.479037    7866 retry.go:31] will retry after 37.509719ms: open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/scheduled-stop-230245/pid: no such file or directory
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-230245 --cancel-scheduled
E1028 17:37:15.753065    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-230245 -n scheduled-stop-230245
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-230245
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-230245 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-230245
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p scheduled-stop-230245: exit status 7 (81.68532ms)

                                                
                                                
-- stdout --
	scheduled-stop-230245
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-230245 -n scheduled-stop-230245
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-230245 -n scheduled-stop-230245: exit status 7 (63.04881ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-230245" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p scheduled-stop-230245
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-230245: (5.156028601s)
--- PASS: TestScheduledStopUnix (107.51s)

                                                
                                    
x
+
TestInsufficientStorage (10.53s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-arm64 start -p insufficient-storage-453481 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p insufficient-storage-453481 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd: exit status 26 (7.956497986s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"1b888e7c-5daf-4172-aabc-19b6217c2050","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-453481] minikube v1.34.0 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"3c0905dc-79cd-46a4-a09c-a823afe6c9a0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19872"}}
	{"specversion":"1.0","id":"c598d384-e035-42b1-a53c-9b0c7dd58758","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"8917f405-6a50-486b-bb6b-074d635d56d4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig"}}
	{"specversion":"1.0","id":"303faa07-fb13-42b2-894f-8a09a5dfaa63","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube"}}
	{"specversion":"1.0","id":"14dd89eb-790f-4bf1-8a8c-76e26d37813d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"f13164d7-6158-4cdc-b66c-2a0b5f18ba8a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"7158f9f2-697e-43d1-ac18-cd095cfa61d1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"ce542b64-98ea-42ef-a824-929d2434c571","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"f5f36dff-292e-44a2-9367-a25cd74e1842","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"eeb55291-54bc-430b-9368-40f541221cb9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"62912d46-2f1e-45c1-8b23-9d08c4035293","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"insufficient-storage-453481\" primary control-plane node in \"insufficient-storage-453481\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"37a614bc-b45f-4fd4-9d5e-505299cae4a6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image v0.0.45-1730110049-19872 ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"fd1226f8-226d-4453-9305-116e790f9fab","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"257a38e6-ae55-4c51-96f6-6316fcc2e29b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-453481 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-453481 --output=json --layout=cluster: exit status 7 (295.913902ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-453481","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.34.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-453481","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E1028 17:38:35.832453  157812 status.go:458] kubeconfig endpoint: get endpoint: "insufficient-storage-453481" does not appear in /home/jenkins/minikube-integration/19872-2421/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-453481 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-453481 --output=json --layout=cluster: exit status 7 (288.101101ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-453481","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.34.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-453481","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E1028 17:38:36.122199  157873 status.go:458] kubeconfig endpoint: get endpoint: "insufficient-storage-453481" does not appear in /home/jenkins/minikube-integration/19872-2421/kubeconfig
	E1028 17:38:36.132396  157873 status.go:258] unable to read event log: stat: stat /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/insufficient-storage-453481/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-453481" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p insufficient-storage-453481
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p insufficient-storage-453481: (1.988856936s)
--- PASS: TestInsufficientStorage (10.53s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (85.5s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run:  /tmp/minikube-v1.26.0.1130347836 start -p running-upgrade-136881 --memory=2200 --vm-driver=docker  --container-runtime=containerd
version_upgrade_test.go:120: (dbg) Done: /tmp/minikube-v1.26.0.1130347836 start -p running-upgrade-136881 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (44.837792884s)
version_upgrade_test.go:130: (dbg) Run:  out/minikube-linux-arm64 start -p running-upgrade-136881 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:130: (dbg) Done: out/minikube-linux-arm64 start -p running-upgrade-136881 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (36.621568496s)
helpers_test.go:175: Cleaning up "running-upgrade-136881" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p running-upgrade-136881
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p running-upgrade-136881: (3.020300201s)
--- PASS: TestRunningBinaryUpgrade (85.50s)

                                                
                                    
x
+
TestKubernetesUpgrade (355.18s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-548970 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
E1028 17:40:01.084807    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
version_upgrade_test.go:222: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-548970 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m1.315043798s)
version_upgrade_test.go:227: (dbg) Run:  out/minikube-linux-arm64 stop -p kubernetes-upgrade-548970
version_upgrade_test.go:227: (dbg) Done: out/minikube-linux-arm64 stop -p kubernetes-upgrade-548970: (1.223261406s)
version_upgrade_test.go:232: (dbg) Run:  out/minikube-linux-arm64 -p kubernetes-upgrade-548970 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-linux-arm64 -p kubernetes-upgrade-548970 status --format={{.Host}}: exit status 7 (71.237057ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-548970 --memory=2200 --kubernetes-version=v1.31.2 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:243: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-548970 --memory=2200 --kubernetes-version=v1.31.2 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (4m39.790493911s)
version_upgrade_test.go:248: (dbg) Run:  kubectl --context kubernetes-upgrade-548970 version --output=json
version_upgrade_test.go:267: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:269: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-548970 --memory=2200 --kubernetes-version=v1.20.0 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:269: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p kubernetes-upgrade-548970 --memory=2200 --kubernetes-version=v1.20.0 --driver=docker  --container-runtime=containerd: exit status 106 (116.732191ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-548970] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19872
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.31.2 cluster to v1.20.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.20.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-548970
	    minikube start -p kubernetes-upgrade-548970 --kubernetes-version=v1.20.0
	    
	    2) Create a second cluster with Kubernetes 1.20.0, by running:
	    
	    minikube start -p kubernetes-upgrade-5489702 --kubernetes-version=v1.20.0
	    
	    3) Use the existing cluster at version Kubernetes 1.31.2, by running:
	    
	    minikube start -p kubernetes-upgrade-548970 --kubernetes-version=v1.31.2
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:273: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:275: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-548970 --memory=2200 --kubernetes-version=v1.31.2 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:275: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-548970 --memory=2200 --kubernetes-version=v1.31.2 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (8.129698891s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-548970" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubernetes-upgrade-548970
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p kubernetes-upgrade-548970: (4.4386744s)
--- PASS: TestKubernetesUpgrade (355.18s)

                                                
                                    
x
+
TestMissingContainerUpgrade (177.89s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:309: (dbg) Run:  /tmp/minikube-v1.26.0.1552441954 start -p missing-upgrade-819375 --memory=2200 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:309: (dbg) Done: /tmp/minikube-v1.26.0.1552441954 start -p missing-upgrade-819375 --memory=2200 --driver=docker  --container-runtime=containerd: (1m31.769729422s)
version_upgrade_test.go:318: (dbg) Run:  docker stop missing-upgrade-819375
version_upgrade_test.go:318: (dbg) Done: docker stop missing-upgrade-819375: (10.367731745s)
version_upgrade_test.go:323: (dbg) Run:  docker rm missing-upgrade-819375
version_upgrade_test.go:329: (dbg) Run:  out/minikube-linux-arm64 start -p missing-upgrade-819375 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:329: (dbg) Done: out/minikube-linux-arm64 start -p missing-upgrade-819375 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m12.949939095s)
helpers_test.go:175: Cleaning up "missing-upgrade-819375" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p missing-upgrade-819375
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p missing-upgrade-819375: (1.99877812s)
--- PASS: TestMissingContainerUpgrade (177.89s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.1s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-874841 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p NoKubernetes-874841 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd: exit status 14 (99.477536ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-874841] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19872
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.10s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (39.32s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-874841 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-874841 --driver=docker  --container-runtime=containerd: (38.887555816s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-874841 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (39.32s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (17.8s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-874841 --no-kubernetes --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-874841 --no-kubernetes --driver=docker  --container-runtime=containerd: (15.455593565s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-874841 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-arm64 -p NoKubernetes-874841 status -o json: exit status 2 (289.431767ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-874841","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-arm64 delete -p NoKubernetes-874841
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-arm64 delete -p NoKubernetes-874841: (2.057718354s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (17.80s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (9.08s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-874841 --no-kubernetes --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-874841 --no-kubernetes --driver=docker  --container-runtime=containerd: (9.075825043s)
--- PASS: TestNoKubernetes/serial/Start (9.08s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.31s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-874841 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-874841 "sudo systemctl is-active --quiet service kubelet": exit status 1 (309.898471ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.31s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (1.25s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (1.25s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.26s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-arm64 stop -p NoKubernetes-874841
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-arm64 stop -p NoKubernetes-874841: (1.260914926s)
--- PASS: TestNoKubernetes/serial/Stop (1.26s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (6.87s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-874841 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-874841 --driver=docker  --container-runtime=containerd: (6.87391771s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (6.87s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.27s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-874841 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-874841 "sudo systemctl is-active --quiet service kubelet": exit status 1 (268.547028ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.27s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (0.99s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (0.99s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (87.53s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run:  /tmp/minikube-v1.26.0.2133780279 start -p stopped-upgrade-111825 --memory=2200 --vm-driver=docker  --container-runtime=containerd
E1028 17:42:15.751140    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
version_upgrade_test.go:183: (dbg) Done: /tmp/minikube-v1.26.0.2133780279 start -p stopped-upgrade-111825 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (43.8767125s)
version_upgrade_test.go:192: (dbg) Run:  /tmp/minikube-v1.26.0.2133780279 -p stopped-upgrade-111825 stop
version_upgrade_test.go:192: (dbg) Done: /tmp/minikube-v1.26.0.2133780279 -p stopped-upgrade-111825 stop: (1.31657197s)
version_upgrade_test.go:198: (dbg) Run:  out/minikube-linux-arm64 start -p stopped-upgrade-111825 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
E1028 17:43:04.153163    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
version_upgrade_test.go:198: (dbg) Done: out/minikube-linux-arm64 start -p stopped-upgrade-111825 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (42.336703207s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (87.53s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (1.69s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run:  out/minikube-linux-arm64 logs -p stopped-upgrade-111825
version_upgrade_test.go:206: (dbg) Done: out/minikube-linux-arm64 logs -p stopped-upgrade-111825: (1.693333792s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.69s)

                                                
                                    
x
+
TestPause/serial/Start (55.11s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-arm64 start -p pause-939019 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd
E1028 17:45:01.084834    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
pause_test.go:80: (dbg) Done: out/minikube-linux-arm64 start -p pause-939019 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd: (55.11241889s)
--- PASS: TestPause/serial/Start (55.11s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (7.81s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-arm64 start -p pause-939019 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
pause_test.go:92: (dbg) Done: out/minikube-linux-arm64 start -p pause-939019 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (7.795369955s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (7.81s)

                                                
                                    
x
+
TestPause/serial/Pause (1.08s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-939019 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-939019 --alsologtostderr -v=5: (1.083359074s)
--- PASS: TestPause/serial/Pause (1.08s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.5s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p pause-939019 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p pause-939019 --output=json --layout=cluster: exit status 2 (502.567838ms)

                                                
                                                
-- stdout --
	{"Name":"pause-939019","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 7 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.34.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-939019","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.50s)

                                                
                                    
x
+
TestPause/serial/Unpause (1.03s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-arm64 unpause -p pause-939019 --alsologtostderr -v=5
pause_test.go:121: (dbg) Done: out/minikube-linux-arm64 unpause -p pause-939019 --alsologtostderr -v=5: (1.029478448s)
--- PASS: TestPause/serial/Unpause (1.03s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (1.28s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-939019 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-939019 --alsologtostderr -v=5: (1.279802672s)
--- PASS: TestPause/serial/PauseAgain (1.28s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (3.26s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p pause-939019 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p pause-939019 --alsologtostderr -v=5: (3.25843982s)
--- PASS: TestPause/serial/DeletePaused (3.26s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.52s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-939019
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-939019: exit status 1 (18.968209ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-939019: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (0.52s)

                                                
                                    
x
+
TestNetworkPlugins/group/false (5.07s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false
net_test.go:246: (dbg) Run:  out/minikube-linux-arm64 start -p false-222958 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd
net_test.go:246: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p false-222958 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd: exit status 14 (206.904694ms)

                                                
                                                
-- stdout --
	* [false-222958] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19872
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on user configuration
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I1028 17:45:56.857924  198046 out.go:345] Setting OutFile to fd 1 ...
	I1028 17:45:56.858047  198046 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:45:56.858055  198046 out.go:358] Setting ErrFile to fd 2...
	I1028 17:45:56.858061  198046 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I1028 17:45:56.858309  198046 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19872-2421/.minikube/bin
	I1028 17:45:56.858713  198046 out.go:352] Setting JSON to false
	I1028 17:45:56.859676  198046 start.go:129] hostinfo: {"hostname":"ip-172-31-24-2","uptime":5303,"bootTime":1730132254,"procs":196,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"6d436adf-771e-4269-b9a3-c25fd4fca4f5"}
	I1028 17:45:56.859751  198046 start.go:139] virtualization:  
	I1028 17:45:56.862734  198046 out.go:177] * [false-222958] minikube v1.34.0 on Ubuntu 20.04 (arm64)
	I1028 17:45:56.865518  198046 out.go:177]   - MINIKUBE_LOCATION=19872
	I1028 17:45:56.865637  198046 notify.go:220] Checking for updates...
	I1028 17:45:56.869669  198046 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I1028 17:45:56.871754  198046 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19872-2421/kubeconfig
	I1028 17:45:56.874285  198046 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19872-2421/.minikube
	I1028 17:45:56.876025  198046 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I1028 17:45:56.877974  198046 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I1028 17:45:56.881300  198046 config.go:182] Loaded profile config "force-systemd-flag-884615": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
	I1028 17:45:56.881472  198046 driver.go:394] Setting default libvirt URI to qemu:///system
	I1028 17:45:56.906272  198046 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
	I1028 17:45:56.906399  198046 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I1028 17:45:56.978903  198046 info.go:266] docker info: {ID:J4M5:W6MX:GOX4:4LAQ:VI7E:VJNF:J3OP:OPBH:GF7G:PPY4:WQWD:7N4L Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:35 OomKillDisable:true NGoroutines:52 SystemTime:2024-10-28 17:45:56.969513989 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1071-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-24-2 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridge
-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
	I1028 17:45:56.979016  198046 docker.go:318] overlay module found
	I1028 17:45:56.981700  198046 out.go:177] * Using the docker driver based on user configuration
	I1028 17:45:56.983737  198046 start.go:297] selected driver: docker
	I1028 17:45:56.983752  198046 start.go:901] validating driver "docker" against <nil>
	I1028 17:45:56.983767  198046 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I1028 17:45:56.986459  198046 out.go:201] 
	W1028 17:45:56.988492  198046 out.go:270] X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	I1028 17:45:56.990561  198046 out.go:201] 

                                                
                                                
** /stderr **
net_test.go:88: 
----------------------- debugLogs start: false-222958 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: false-222958

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: false-222958

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: false-222958

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: false-222958

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: false-222958

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: false-222958

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: false-222958

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: false-222958

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: false-222958

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: false-222958

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: false-222958

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "false-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "false-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "false-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "false-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "false-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "false-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "false-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "false-222958" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "false-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "false-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "false-222958" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: false-222958

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "false-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-222958"

                                                
                                                
----------------------- debugLogs end: false-222958 [took: 4.6790404s] --------------------------------
helpers_test.go:175: Cleaning up "false-222958" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p false-222958
--- PASS: TestNetworkPlugins/group/false (5.07s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (151.8s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-743648 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-743648 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0: (2m31.795209769s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (151.80s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (9.61s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-743648 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [e0a4867e-668a-41b2-9e0a-5d314b8999aa] Pending
helpers_test.go:344: "busybox" [e0a4867e-668a-41b2-9e0a-5d314b8999aa] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [e0a4867e-668a-41b2-9e0a-5d314b8999aa] Running
E1028 17:50:01.084782    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 9.004231862s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-743648 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (9.61s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.72s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-743648 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-743648 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.491023715s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-743648 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.72s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (12.43s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p old-k8s-version-743648 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p old-k8s-version-743648 --alsologtostderr -v=3: (12.426983552s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (12.43s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (78.48s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-671620 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2
E1028 17:50:18.822163    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-671620 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2: (1m18.47686258s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (78.48s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-743648 -n old-k8s-version-743648
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-743648 -n old-k8s-version-743648: exit status 7 (79.921505ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p old-k8s-version-743648 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.23s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (10.34s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-671620 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [966aa2d5-b8f5-4297-9f0d-e4d98d316031] Pending
helpers_test.go:344: "busybox" [966aa2d5-b8f5-4297-9f0d-e4d98d316031] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [966aa2d5-b8f5-4297-9f0d-e4d98d316031] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 10.004421728s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-671620 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (10.34s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.14s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p no-preload-671620 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p no-preload-671620 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.028536612s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-671620 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.14s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (12.21s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p no-preload-671620 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p no-preload-671620 --alsologtostderr -v=3: (12.205049541s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (12.21s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-671620 -n no-preload-671620
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-671620 -n no-preload-671620: exit status 7 (77.972595ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p no-preload-671620 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.19s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (266.67s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-671620 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2
E1028 17:52:15.751778    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:55:01.084202    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-671620 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2: (4m26.322224712s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-671620 -n no-preload-671620
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (266.67s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-695b96c756-wmwmc" [60fdcd1e-5c56-42b8-8ba1-2c67b16e9a0c] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003669775s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6.00s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.13s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-695b96c756-wmwmc" [60fdcd1e-5c56-42b8-8ba1-2c67b16e9a0c] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.003427257s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-671620 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.13s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.31s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p no-preload-671620 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20241007-36f62932
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.31s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (3.61s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p no-preload-671620 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 pause -p no-preload-671620 --alsologtostderr -v=1: (1.087118419s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-671620 -n no-preload-671620
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-671620 -n no-preload-671620: exit status 2 (444.485789ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-671620 -n no-preload-671620
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-671620 -n no-preload-671620: exit status 2 (433.446194ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p no-preload-671620 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-671620 -n no-preload-671620
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-671620 -n no-preload-671620
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.61s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-cd95d586-k2vc6" [77467abd-bce7-4e66-8c13-a88a7599d9d9] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.00431788s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (90.07s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-718674 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-718674 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2: (1m30.069080642s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (90.07s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.2s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-cd95d586-k2vc6" [77467abd-bce7-4e66-8c13-a88a7599d9d9] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.004613055s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-743648 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.20s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.64s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p old-k8s-version-743648 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240202-8f1494ea
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20241007-36f62932
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.64s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (3.25s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p old-k8s-version-743648 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 pause -p old-k8s-version-743648 --alsologtostderr -v=1: (1.019965878s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-743648 -n old-k8s-version-743648
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-743648 -n old-k8s-version-743648: exit status 2 (341.085387ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-743648 -n old-k8s-version-743648
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-743648 -n old-k8s-version-743648: exit status 2 (320.641405ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p old-k8s-version-743648 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-743648 -n old-k8s-version-743648
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-743648 -n old-k8s-version-743648
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (3.25s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (59.55s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-934800 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2
E1028 17:57:15.750955    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-934800 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2: (59.552749022s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (59.55s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (9.37s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-934800 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [25e38b2c-5808-4cf1-a265-97f934c8dd37] Pending
helpers_test.go:344: "busybox" [25e38b2c-5808-4cf1-a265-97f934c8dd37] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [25e38b2c-5808-4cf1-a265-97f934c8dd37] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 9.006505507s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-934800 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (9.37s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.19s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-934800 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-934800 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.089220865s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-934800 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.19s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (12.11s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p default-k8s-diff-port-934800 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p default-k8s-diff-port-934800 --alsologtostderr -v=3: (12.114721179s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (12.11s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (9.32s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-718674 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [1f65a9e3-9c1f-4242-8342-fb70ed625b78] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [1f65a9e3-9c1f-4242-8342-fb70ed625b78] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 9.003866383s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-718674 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (9.32s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.21s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-934800 -n default-k8s-diff-port-934800
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-934800 -n default-k8s-diff-port-934800: exit status 7 (87.387435ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p default-k8s-diff-port-934800 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.21s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (289.68s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-934800 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-934800 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2: (4m49.33742242s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-934800 -n default-k8s-diff-port-934800
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (289.68s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.58s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-718674 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-718674 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.409822227s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-718674 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.58s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (12.28s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p embed-certs-718674 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p embed-certs-718674 --alsologtostderr -v=3: (12.275944099s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (12.28s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.22s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-718674 -n embed-certs-718674
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-718674 -n embed-certs-718674: exit status 7 (102.841879ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p embed-certs-718674 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.22s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (268.6s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-718674 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2
E1028 17:59:44.155362    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:59:56.293128    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:59:56.299397    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:59:56.310885    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:59:56.332815    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:59:56.374180    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:59:56.455579    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:59:56.617070    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:59:56.938704    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:59:57.580377    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 17:59:58.861843    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:00:01.105352    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:00:01.424952    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:00:06.547172    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:00:16.788518    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:00:37.270125    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:01:18.232480    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:01:33.564967    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:01:33.571304    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:01:33.582707    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:01:33.604079    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:01:33.645543    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:01:33.727034    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:01:33.889261    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:01:34.210923    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:01:34.852839    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:01:36.134967    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:01:38.696440    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:01:43.818855    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:01:54.060830    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:02:14.542765    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:02:15.750835    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/functional-137003/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:02:40.154238    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:02:55.504912    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-718674 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2: (4m28.231841218s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-718674 -n embed-certs-718674
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (268.60s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-695b96c756-txrzt" [413c509d-1065-4130-903c-b4f5609dd829] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004054151s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-695b96c756-4cjbh" [4b24f73c-4ca5-42e6-863e-e7a3baf01835] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004365306s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.12s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-695b96c756-txrzt" [413c509d-1065-4130-903c-b4f5609dd829] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.005059449s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-718674 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.12s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.15s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-695b96c756-4cjbh" [4b24f73c-4ca5-42e6-863e-e7a3baf01835] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.013527411s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-934800 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.15s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.25s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p embed-certs-718674 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20241007-36f62932
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.25s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (3.09s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p embed-certs-718674 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-718674 -n embed-certs-718674
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-718674 -n embed-certs-718674: exit status 2 (325.629872ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-718674 -n embed-certs-718674
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-718674 -n embed-certs-718674: exit status 2 (339.316127ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p embed-certs-718674 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-718674 -n embed-certs-718674
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-718674 -n embed-certs-718674
--- PASS: TestStartStop/group/embed-certs/serial/Pause (3.09s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.37s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p default-k8s-diff-port-934800 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20241007-36f62932
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.37s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (4.31s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p default-k8s-diff-port-934800 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 pause -p default-k8s-diff-port-934800 --alsologtostderr -v=1: (1.068099595s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-934800 -n default-k8s-diff-port-934800
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-934800 -n default-k8s-diff-port-934800: exit status 2 (403.28202ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-934800 -n default-k8s-diff-port-934800
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-934800 -n default-k8s-diff-port-934800: exit status 2 (390.521928ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p default-k8s-diff-port-934800 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 unpause -p default-k8s-diff-port-934800 --alsologtostderr -v=1: (1.077038398s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-934800 -n default-k8s-diff-port-934800
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-934800 -n default-k8s-diff-port-934800
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (4.31s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (45.01s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-562405 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-562405 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2: (45.01240415s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (45.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (85.59s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p auto-222958 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p auto-222958 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd: (1m25.5864192s)
--- PASS: TestNetworkPlugins/group/auto/Start (85.59s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.52s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-562405 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-562405 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.515603113s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.52s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (1.36s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p newest-cni-562405 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p newest-cni-562405 --alsologtostderr -v=3: (1.36407122s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (1.36s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.33s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-562405 -n newest-cni-562405
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-562405 -n newest-cni-562405: exit status 7 (148.671529ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p newest-cni-562405 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.33s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (16.58s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-562405 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2
E1028 18:04:17.426605    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/no-preload-671620/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-562405 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.2: (16.014196657s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-562405 -n newest-cni-562405
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (16.58s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.34s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p newest-cni-562405 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20241007-36f62932
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.34s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (3.31s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p newest-cni-562405 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-562405 -n newest-cni-562405
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-562405 -n newest-cni-562405: exit status 2 (348.93488ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-562405 -n newest-cni-562405
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-562405 -n newest-cni-562405: exit status 2 (326.060349ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p newest-cni-562405 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-562405 -n newest-cni-562405
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-562405 -n newest-cni-562405
--- PASS: TestStartStop/group/newest-cni/serial/Pause (3.31s)
E1028 18:09:53.699165    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/auto-222958/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:09:53.705622    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/auto-222958/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:09:53.717072    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/auto-222958/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:09:53.738511    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/auto-222958/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:09:53.779891    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/auto-222958/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:09:53.861288    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/auto-222958/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:09:54.022835    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/auto-222958/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:09:54.344559    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/auto-222958/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:09:54.986171    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/auto-222958/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:09:56.267607    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/auto-222958/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:09:56.293104    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:09:58.829084    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/auto-222958/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:10:01.084320    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:10:03.950521    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/auto-222958/client.crt: no such file or directory" logger="UnhandledError"
E1028 18:10:14.192216    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/auto-222958/client.crt: no such file or directory" logger="UnhandledError"

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (81.98s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kindnet-222958 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kindnet-222958 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd: (1m21.98484639s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (81.98s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.39s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p auto-222958 "pgrep -a kubelet"
I1028 18:04:53.361767    7866 config.go:182] Loaded profile config "auto-222958": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.39s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (11.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-222958 replace --force -f testdata/netcat-deployment.yaml
I1028 18:04:53.722866    7866 kapi.go:136] Waiting for deployment netcat to stabilize, generation 1 observed generation 1 spec.replicas 1 status.replicas 0
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6fc964789b-x5sgh" [6bf68627-b549-4b91-9132-f07b26c05a91] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E1028 18:04:56.293793    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/old-k8s-version-743648/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:344: "netcat-6fc964789b-x5sgh" [6bf68627-b549-4b91-9132-f07b26c05a91] Running
E1028 18:05:01.084691    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/addons-896964/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 11.005072532s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (11.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-222958 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-222958 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-222958 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (67.96s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p calico-222958 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p calico-222958 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd: (1m7.962739109s)
--- PASS: TestNetworkPlugins/group/calico/Start (67.96s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-md94x" [9de850c6-1820-4426-9888-a17d686331be] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 6.006261053s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.48s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kindnet-222958 "pgrep -a kubelet"
I1028 18:06:01.059732    7866 config.go:182] Loaded profile config "kindnet-222958": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.48s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (11.39s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-222958 replace --force -f testdata/netcat-deployment.yaml
I1028 18:06:01.441090    7866 kapi.go:136] Waiting for deployment netcat to stabilize, generation 1 observed generation 1 spec.replicas 1 status.replicas 0
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6fc964789b-rklzl" [6224cc88-8f19-4c6b-a725-fcc9976e8a1c] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6fc964789b-rklzl" [6224cc88-8f19-4c6b-a725-fcc9976e8a1c] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 11.004684039s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (11.39s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-222958 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-222958 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-222958 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-j2bhb" [c7c204c2-99ef-464a-bc7e-37d88ed123dd] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 6.004815382s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (56.94s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-flannel-222958 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-flannel-222958 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd: (56.943908475s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (56.94s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p calico-222958 "pgrep -a kubelet"
I1028 18:06:40.612179    7866 config.go:182] Loaded profile config "calico-222958": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (11.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-222958 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6fc964789b-m9djl" [0566171e-ba2a-44c6-ae8a-064abd2e8069] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6fc964789b-m9djl" [0566171e-ba2a-44c6-ae8a-064abd2e8069] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 11.003632342s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (11.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-222958 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-222958 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-222958 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (71.79s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p enable-default-cni-222958 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p enable-default-cni-222958 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd: (1m11.786163877s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (71.79s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p custom-flannel-222958 "pgrep -a kubelet"
I1028 18:07:32.531993    7866 config.go:182] Loaded profile config "custom-flannel-222958": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (10.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-222958 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6fc964789b-x8596" [4918a114-9cc0-4c42-a362-20bf65f03e8f] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6fc964789b-x8596" [4918a114-9cc0-4c42-a362-20bf65f03e8f] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 10.005072213s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (10.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-222958 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-222958 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-222958 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (54.72s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p flannel-222958 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd
E1028 18:08:16.081555    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/default-k8s-diff-port-934800/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p flannel-222958 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd: (54.715196152s)
--- PASS: TestNetworkPlugins/group/flannel/Start (54.72s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.43s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p enable-default-cni-222958 "pgrep -a kubelet"
I1028 18:08:31.513958    7866 config.go:182] Loaded profile config "enable-default-cni-222958": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.43s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (11.47s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-222958 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6fc964789b-qdg7x" [e7252f0d-9743-4f58-98b7-2d087b47c071] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E1028 18:08:36.564132    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/default-k8s-diff-port-934800/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:344: "netcat-6fc964789b-qdg7x" [e7252f0d-9743-4f58-98b7-2d087b47c071] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 11.003655873s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (11.47s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-222958 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-222958 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-222958 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-gg6st" [13999886-9565-440c-b040-09258c94e33a] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 6.004563943s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (83.51s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p bridge-222958 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p bridge-222958 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd: (1m23.511720948s)
--- PASS: TestNetworkPlugins/group/bridge/Start (83.51s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p flannel-222958 "pgrep -a kubelet"
I1028 18:09:08.838939    7866 config.go:182] Loaded profile config "flannel-222958": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (11.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-222958 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6fc964789b-fv75h" [c1679a39-45ae-44f9-b446-4e4d1f002302] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6fc964789b-fv75h" [c1679a39-45ae-44f9-b446-4e4d1f002302] Running
E1028 18:09:17.526042    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/default-k8s-diff-port-934800/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 11.0055928s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (11.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-222958 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-222958 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-222958 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p bridge-222958 "pgrep -a kubelet"
I1028 18:10:28.663910    7866 config.go:182] Loaded profile config "bridge-222958": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.2
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (10.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-222958 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6fc964789b-xd62f" [73b49ddb-db2b-4425-add4-1a8fa2be6587] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6fc964789b-xd62f" [73b49ddb-db2b-4425-add4-1a8fa2be6587] Running
E1028 18:10:34.674425    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/auto-222958/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 10.003807902s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (10.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-222958 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-222958 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-222958 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
E1028 18:10:39.447345    7866 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19872-2421/.minikube/profiles/default-k8s-diff-port-934800/client.crt: no such file or directory" logger="UnhandledError"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.16s)

                                                
                                    

Test skip (29/330)

x
+
TestDownloadOnly/v1.20.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.20.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.20.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.20.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.31.2/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.31.2/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.2/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.2/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.31.2/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0.54s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:232: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p download-docker-850953 --alsologtostderr --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:244: Skip for arm64 platform. See https://github.com/kubernetes/minikube/issues/10144
helpers_test.go:175: Cleaning up "download-docker-850953" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p download-docker-850953
--- SKIP: TestDownloadOnlyKic (0.54s)

                                                
                                    
x
+
TestOffline (0s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:35: skipping TestOffline - only docker runtime supported on arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestOffline (0.00s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/RealCredentials (0s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/RealCredentials
addons_test.go:698: This test requires a GCE instance (excluding Cloud Shell) with a container based driver
--- SKIP: TestAddons/serial/GCPAuth/RealCredentials (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:422: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestAddons/parallel/AmdGpuDevicePlugin (0s)

                                                
                                                
=== RUN   TestAddons/parallel/AmdGpuDevicePlugin
=== PAUSE TestAddons/parallel/AmdGpuDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/AmdGpuDevicePlugin
addons_test.go:972: skip amd gpu test on all but docker driver and amd64 platform
--- SKIP: TestAddons/parallel/AmdGpuDevicePlugin (0.00s)

                                                
                                    
x
+
TestDockerFlags (0s)

                                                
                                                
=== RUN   TestDockerFlags
docker_test.go:41: skipping: only runs with docker container runtime, currently testing containerd
--- SKIP: TestDockerFlags (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:45: Skip if arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1787: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DockerEnv
functional_test.go:463: only validate docker env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:550: only validate podman env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild (0s)

                                                
                                                
=== RUN   TestImageBuild
image_test.go:33: 
--- SKIP: TestImageBuild (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestSkaffold (0s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing containerd container runtime
--- SKIP: TestSkaffold (0.00s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-606009" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p disable-driver-mounts-606009
--- SKIP: TestStartStop/group/disable-driver-mounts (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet (5.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet
net_test.go:93: Skipping the test as containerd container runtimes requires CNI
panic.go:629: 
----------------------- debugLogs start: kubenet-222958 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-222958

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: kubenet-222958

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-222958

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: kubenet-222958

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: kubenet-222958

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: kubenet-222958

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: kubenet-222958

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: kubenet-222958

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: kubenet-222958

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: kubenet-222958

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: kubenet-222958

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "kubenet-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "kubenet-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "kubenet-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "kubenet-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "kubenet-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "kubenet-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "kubenet-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "kubenet-222958" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "kubenet-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "kubenet-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "kubenet-222958" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: kubenet-222958

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "kubenet-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-222958"

                                                
                                                
----------------------- debugLogs end: kubenet-222958 [took: 5.087809266s] --------------------------------
helpers_test.go:175: Cleaning up "kubenet-222958" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubenet-222958
--- SKIP: TestNetworkPlugins/group/kubenet (5.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (5.02s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:629: 
----------------------- debugLogs start: cilium-222958 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-222958" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-222958" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-222958" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-222958

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-222958" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-222958"

                                                
                                                
----------------------- debugLogs end: cilium-222958 [took: 4.831155145s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-222958" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cilium-222958
--- SKIP: TestNetworkPlugins/group/cilium (5.02s)

                                                
                                    
Copied to clipboard