Test Report: Docker_Linux_containerd_arm64 20534

                    
                      ca4340fb5ae0bb74f259779cd383137dc2ab446a:2025-04-14:39132
                    
                

Test fail (1/331)

Order failed test Duration
305 TestStartStop/group/old-k8s-version/serial/SecondStart 380.89
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (380.89s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-943255 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:254: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-943255 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m16.350818018s)

                                                
                                                
-- stdout --
	* [old-k8s-version-943255] minikube v1.35.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=20534
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.32.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.32.2
	* Using the docker driver based on existing profile
	* Starting "old-k8s-version-943255" primary control-plane node in "old-k8s-version-943255" cluster
	* Pulling base image v0.0.46-1744107393-20604 ...
	* Restarting existing docker container for "old-k8s-version-943255" ...
	* Preparing Kubernetes v1.20.0 on containerd 1.7.27 ...
	* Verifying Kubernetes components...
	  - Using image fake.domain/registry.k8s.io/echoserver:1.4
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	  - Using image docker.io/kubernetesui/dashboard:v2.7.0
	  - Using image registry.k8s.io/echoserver:1.4
	* Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p old-k8s-version-943255 addons enable metrics-server
	
	* Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0414 11:38:43.707239  808013 out.go:345] Setting OutFile to fd 1 ...
	I0414 11:38:43.707468  808013 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:38:43.707496  808013 out.go:358] Setting ErrFile to fd 2...
	I0414 11:38:43.707513  808013 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:38:43.707797  808013 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
	I0414 11:38:43.708196  808013 out.go:352] Setting JSON to false
	I0414 11:38:43.709228  808013 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":12069,"bootTime":1744618655,"procs":180,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1081-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0414 11:38:43.709320  808013 start.go:139] virtualization:  
	I0414 11:38:43.712576  808013 out.go:177] * [old-k8s-version-943255] minikube v1.35.0 on Ubuntu 20.04 (arm64)
	I0414 11:38:43.716642  808013 out.go:177]   - MINIKUBE_LOCATION=20534
	I0414 11:38:43.716697  808013 notify.go:220] Checking for updates...
	I0414 11:38:43.723236  808013 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0414 11:38:43.726030  808013 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig
	I0414 11:38:43.728825  808013 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube
	I0414 11:38:43.731599  808013 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0414 11:38:43.734433  808013 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0414 11:38:43.737879  808013 config.go:182] Loaded profile config "old-k8s-version-943255": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0414 11:38:43.741239  808013 out.go:177] * Kubernetes 1.32.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.32.2
	I0414 11:38:43.743978  808013 driver.go:394] Setting default libvirt URI to qemu:///system
	I0414 11:38:43.780892  808013 docker.go:123] docker version: linux-28.0.4:Docker Engine - Community
	I0414 11:38:43.780999  808013 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0414 11:38:43.867987  808013 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:51 OomKillDisable:true NGoroutines:60 SystemTime:2025-04-14 11:38:43.858925811 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1081-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0]] Warnings:<nil>}}
	I0414 11:38:43.868087  808013 docker.go:318] overlay module found
	I0414 11:38:43.871031  808013 out.go:177] * Using the docker driver based on existing profile
	I0414 11:38:43.873760  808013 start.go:297] selected driver: docker
	I0414 11:38:43.873813  808013 start.go:901] validating driver "docker" against &{Name:old-k8s-version-943255 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-943255 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0414 11:38:43.873917  808013 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0414 11:38:43.874636  808013 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0414 11:38:43.961549  808013 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:51 OomKillDisable:true NGoroutines:60 SystemTime:2025-04-14 11:38:43.952673268 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1081-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0]] Warnings:<nil>}}
	I0414 11:38:43.961947  808013 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0414 11:38:43.961976  808013 cni.go:84] Creating CNI manager for ""
	I0414 11:38:43.962022  808013 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0414 11:38:43.962054  808013 start.go:340] cluster config:
	{Name:old-k8s-version-943255 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-943255 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0414 11:38:43.965094  808013 out.go:177] * Starting "old-k8s-version-943255" primary control-plane node in "old-k8s-version-943255" cluster
	I0414 11:38:43.967808  808013 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0414 11:38:43.971808  808013 out.go:177] * Pulling base image v0.0.46-1744107393-20604 ...
	I0414 11:38:43.974238  808013 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0414 11:38:43.974288  808013 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20534-594855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
	I0414 11:38:43.974309  808013 cache.go:56] Caching tarball of preloaded images
	I0414 11:38:43.974404  808013 preload.go:172] Found /home/jenkins/minikube-integration/20534-594855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I0414 11:38:43.974414  808013 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
	I0414 11:38:43.974522  808013 profile.go:143] Saving config to /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/config.json ...
	I0414 11:38:43.974747  808013 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a in local docker daemon
	I0414 11:38:43.998898  808013 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a in local docker daemon, skipping pull
	I0414 11:38:43.998917  808013 cache.go:145] gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a exists in daemon, skipping load
	I0414 11:38:43.998930  808013 cache.go:230] Successfully downloaded all kic artifacts
	I0414 11:38:43.998952  808013 start.go:360] acquireMachinesLock for old-k8s-version-943255: {Name:mk889cffa6536044df3c10ded0e32a25d6db23c3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0414 11:38:43.999003  808013 start.go:364] duration metric: took 33.962µs to acquireMachinesLock for "old-k8s-version-943255"
	I0414 11:38:43.999022  808013 start.go:96] Skipping create...Using existing machine configuration
	I0414 11:38:43.999027  808013 fix.go:54] fixHost starting: 
	I0414 11:38:43.999279  808013 cli_runner.go:164] Run: docker container inspect old-k8s-version-943255 --format={{.State.Status}}
	I0414 11:38:44.018206  808013 fix.go:112] recreateIfNeeded on old-k8s-version-943255: state=Stopped err=<nil>
	W0414 11:38:44.018241  808013 fix.go:138] unexpected machine state, will restart: <nil>
	I0414 11:38:44.021097  808013 out.go:177] * Restarting existing docker container for "old-k8s-version-943255" ...
	I0414 11:38:44.023691  808013 cli_runner.go:164] Run: docker start old-k8s-version-943255
	I0414 11:38:44.336238  808013 cli_runner.go:164] Run: docker container inspect old-k8s-version-943255 --format={{.State.Status}}
	I0414 11:38:44.358123  808013 kic.go:430] container "old-k8s-version-943255" state is running.
	I0414 11:38:44.358522  808013 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-943255
	I0414 11:38:44.381291  808013 profile.go:143] Saving config to /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/config.json ...
	I0414 11:38:44.381521  808013 machine.go:93] provisionDockerMachine start ...
	I0414 11:38:44.381581  808013 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-943255
	I0414 11:38:44.404474  808013 main.go:141] libmachine: Using SSH client type: native
	I0414 11:38:44.404798  808013 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e66c0] 0x3e8e80 <nil>  [] 0s} 127.0.0.1 33806 <nil> <nil>}
	I0414 11:38:44.404808  808013 main.go:141] libmachine: About to run SSH command:
	hostname
	I0414 11:38:44.405391  808013 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:48646->127.0.0.1:33806: read: connection reset by peer
	I0414 11:38:47.545443  808013 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-943255
	
	I0414 11:38:47.545524  808013 ubuntu.go:169] provisioning hostname "old-k8s-version-943255"
	I0414 11:38:47.545616  808013 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-943255
	I0414 11:38:47.581365  808013 main.go:141] libmachine: Using SSH client type: native
	I0414 11:38:47.581674  808013 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e66c0] 0x3e8e80 <nil>  [] 0s} 127.0.0.1 33806 <nil> <nil>}
	I0414 11:38:47.581686  808013 main.go:141] libmachine: About to run SSH command:
	sudo hostname old-k8s-version-943255 && echo "old-k8s-version-943255" | sudo tee /etc/hostname
	I0414 11:38:47.745399  808013 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-943255
	
	I0414 11:38:47.745474  808013 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-943255
	I0414 11:38:47.799658  808013 main.go:141] libmachine: Using SSH client type: native
	I0414 11:38:47.799976  808013 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e66c0] 0x3e8e80 <nil>  [] 0s} 127.0.0.1 33806 <nil> <nil>}
	I0414 11:38:47.799993  808013 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sold-k8s-version-943255' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-943255/g' /etc/hosts;
				else 
					echo '127.0.1.1 old-k8s-version-943255' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0414 11:38:47.934164  808013 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0414 11:38:47.934238  808013 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/20534-594855/.minikube CaCertPath:/home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20534-594855/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20534-594855/.minikube}
	I0414 11:38:47.934278  808013 ubuntu.go:177] setting up certificates
	I0414 11:38:47.934315  808013 provision.go:84] configureAuth start
	I0414 11:38:47.934419  808013 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-943255
	I0414 11:38:47.964685  808013 provision.go:143] copyHostCerts
	I0414 11:38:47.964763  808013 exec_runner.go:144] found /home/jenkins/minikube-integration/20534-594855/.minikube/ca.pem, removing ...
	I0414 11:38:47.964780  808013 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20534-594855/.minikube/ca.pem
	I0414 11:38:47.964858  808013 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20534-594855/.minikube/ca.pem (1082 bytes)
	I0414 11:38:47.964951  808013 exec_runner.go:144] found /home/jenkins/minikube-integration/20534-594855/.minikube/cert.pem, removing ...
	I0414 11:38:47.964956  808013 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20534-594855/.minikube/cert.pem
	I0414 11:38:47.964988  808013 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20534-594855/.minikube/cert.pem (1123 bytes)
	I0414 11:38:47.965060  808013 exec_runner.go:144] found /home/jenkins/minikube-integration/20534-594855/.minikube/key.pem, removing ...
	I0414 11:38:47.965065  808013 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20534-594855/.minikube/key.pem
	I0414 11:38:47.965092  808013 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20534-594855/.minikube/key.pem (1675 bytes)
	I0414 11:38:47.965138  808013 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20534-594855/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-943255 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-943255]
	I0414 11:38:48.506998  808013 provision.go:177] copyRemoteCerts
	I0414 11:38:48.507121  808013 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0414 11:38:48.507200  808013 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-943255
	I0414 11:38:48.524608  808013 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33806 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/old-k8s-version-943255/id_rsa Username:docker}
	I0414 11:38:48.627084  808013 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0414 11:38:48.672001  808013 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
	I0414 11:38:48.717623  808013 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0414 11:38:48.750298  808013 provision.go:87] duration metric: took 815.949677ms to configureAuth
	I0414 11:38:48.750321  808013 ubuntu.go:193] setting minikube options for container-runtime
	I0414 11:38:48.750524  808013 config.go:182] Loaded profile config "old-k8s-version-943255": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0414 11:38:48.750532  808013 machine.go:96] duration metric: took 4.369003929s to provisionDockerMachine
	I0414 11:38:48.750539  808013 start.go:293] postStartSetup for "old-k8s-version-943255" (driver="docker")
	I0414 11:38:48.750549  808013 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0414 11:38:48.750602  808013 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0414 11:38:48.750644  808013 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-943255
	I0414 11:38:48.776250  808013 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33806 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/old-k8s-version-943255/id_rsa Username:docker}
	I0414 11:38:48.878385  808013 ssh_runner.go:195] Run: cat /etc/os-release
	I0414 11:38:48.884244  808013 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0414 11:38:48.884277  808013 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0414 11:38:48.884294  808013 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0414 11:38:48.884304  808013 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0414 11:38:48.884318  808013 filesync.go:126] Scanning /home/jenkins/minikube-integration/20534-594855/.minikube/addons for local assets ...
	I0414 11:38:48.884372  808013 filesync.go:126] Scanning /home/jenkins/minikube-integration/20534-594855/.minikube/files for local assets ...
	I0414 11:38:48.884448  808013 filesync.go:149] local asset: /home/jenkins/minikube-integration/20534-594855/.minikube/files/etc/ssl/certs/6002272.pem -> 6002272.pem in /etc/ssl/certs
	I0414 11:38:48.884553  808013 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0414 11:38:48.899260  808013 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/files/etc/ssl/certs/6002272.pem --> /etc/ssl/certs/6002272.pem (1708 bytes)
	I0414 11:38:48.936743  808013 start.go:296] duration metric: took 186.188227ms for postStartSetup
	I0414 11:38:48.936886  808013 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0414 11:38:48.936971  808013 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-943255
	I0414 11:38:48.964636  808013 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33806 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/old-k8s-version-943255/id_rsa Username:docker}
	I0414 11:38:49.056170  808013 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0414 11:38:49.064143  808013 fix.go:56] duration metric: took 5.065108671s for fixHost
	I0414 11:38:49.064165  808013 start.go:83] releasing machines lock for "old-k8s-version-943255", held for 5.065154029s
	I0414 11:38:49.064250  808013 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-943255
	I0414 11:38:49.091487  808013 ssh_runner.go:195] Run: cat /version.json
	I0414 11:38:49.091549  808013 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-943255
	I0414 11:38:49.091799  808013 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0414 11:38:49.091856  808013 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-943255
	I0414 11:38:49.127034  808013 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33806 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/old-k8s-version-943255/id_rsa Username:docker}
	I0414 11:38:49.130074  808013 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33806 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/old-k8s-version-943255/id_rsa Username:docker}
	I0414 11:38:49.217796  808013 ssh_runner.go:195] Run: systemctl --version
	I0414 11:38:49.381925  808013 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0414 11:38:49.390455  808013 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0414 11:38:49.429304  808013 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0414 11:38:49.429454  808013 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0414 11:38:49.439536  808013 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0414 11:38:49.439614  808013 start.go:495] detecting cgroup driver to use...
	I0414 11:38:49.439657  808013 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0414 11:38:49.439733  808013 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0414 11:38:49.462152  808013 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0414 11:38:49.479349  808013 docker.go:217] disabling cri-docker service (if available) ...
	I0414 11:38:49.479467  808013 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0414 11:38:49.499383  808013 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0414 11:38:49.519787  808013 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0414 11:38:49.653957  808013 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0414 11:38:49.782260  808013 docker.go:233] disabling docker service ...
	I0414 11:38:49.782371  808013 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0414 11:38:49.796366  808013 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0414 11:38:49.808785  808013 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0414 11:38:49.948626  808013 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0414 11:38:50.068109  808013 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0414 11:38:50.088553  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0414 11:38:50.114874  808013 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
	I0414 11:38:50.125255  808013 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0414 11:38:50.151454  808013 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I0414 11:38:50.151603  808013 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0414 11:38:50.164676  808013 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0414 11:38:50.176874  808013 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0414 11:38:50.187516  808013 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0414 11:38:50.198057  808013 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0414 11:38:50.208143  808013 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0414 11:38:50.224610  808013 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0414 11:38:50.238438  808013 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0414 11:38:50.249209  808013 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0414 11:38:50.395382  808013 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0414 11:38:50.687166  808013 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
	I0414 11:38:50.687325  808013 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0414 11:38:50.691768  808013 start.go:563] Will wait 60s for crictl version
	I0414 11:38:50.691902  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:38:50.696254  808013 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0414 11:38:50.817039  808013 start.go:579] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.7.27
	RuntimeApiVersion:  v1
	I0414 11:38:50.817187  808013 ssh_runner.go:195] Run: containerd --version
	I0414 11:38:50.856386  808013 ssh_runner.go:195] Run: containerd --version
	I0414 11:38:50.901268  808013 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.27 ...
	I0414 11:38:50.904360  808013 cli_runner.go:164] Run: docker network inspect old-k8s-version-943255 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0414 11:38:50.934076  808013 ssh_runner.go:195] Run: grep 192.168.76.1	host.minikube.internal$ /etc/hosts
	I0414 11:38:50.938207  808013 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0414 11:38:50.950409  808013 kubeadm.go:883] updating cluster {Name:old-k8s-version-943255 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-943255 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0414 11:38:50.950520  808013 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0414 11:38:50.950589  808013 ssh_runner.go:195] Run: sudo crictl images --output json
	I0414 11:38:51.001200  808013 containerd.go:627] all images are preloaded for containerd runtime.
	I0414 11:38:51.001220  808013 containerd.go:534] Images already preloaded, skipping extraction
	I0414 11:38:51.001281  808013 ssh_runner.go:195] Run: sudo crictl images --output json
	I0414 11:38:51.043348  808013 containerd.go:627] all images are preloaded for containerd runtime.
	I0414 11:38:51.043420  808013 cache_images.go:84] Images are preloaded, skipping loading
	I0414 11:38:51.043444  808013 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
	I0414 11:38:51.043629  808013 kubeadm.go:946] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-943255 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-943255 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0414 11:38:51.043746  808013 ssh_runner.go:195] Run: sudo crictl info
	I0414 11:38:51.110067  808013 cni.go:84] Creating CNI manager for ""
	I0414 11:38:51.110143  808013 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0414 11:38:51.110177  808013 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0414 11:38:51.110229  808013 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-943255 NodeName:old-k8s-version-943255 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
	I0414 11:38:51.110406  808013 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.76.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "old-k8s-version-943255"
	  kubeletExtraArgs:
	    node-ip: 192.168.76.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.20.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0414 11:38:51.110507  808013 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
	I0414 11:38:51.123208  808013 binaries.go:44] Found k8s binaries, skipping transfer
	I0414 11:38:51.123341  808013 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0414 11:38:51.133927  808013 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
	I0414 11:38:51.161748  808013 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0414 11:38:51.190500  808013 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
	I0414 11:38:51.230236  808013 ssh_runner.go:195] Run: grep 192.168.76.2	control-plane.minikube.internal$ /etc/hosts
	I0414 11:38:51.234137  808013 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0414 11:38:51.245680  808013 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0414 11:38:51.389791  808013 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0414 11:38:51.409666  808013 certs.go:68] Setting up /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255 for IP: 192.168.76.2
	I0414 11:38:51.409732  808013 certs.go:194] generating shared ca certs ...
	I0414 11:38:51.409763  808013 certs.go:226] acquiring lock for ca certs: {Name:mkc72929fdde159a4ce614d0ceb68f60716f5790 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0414 11:38:51.409986  808013 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20534-594855/.minikube/ca.key
	I0414 11:38:51.410066  808013 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20534-594855/.minikube/proxy-client-ca.key
	I0414 11:38:51.410103  808013 certs.go:256] generating profile certs ...
	I0414 11:38:51.410237  808013 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.key
	I0414 11:38:51.410359  808013 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/apiserver.key.c15fc179
	I0414 11:38:51.410447  808013 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/proxy-client.key
	I0414 11:38:51.410608  808013 certs.go:484] found cert: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/600227.pem (1338 bytes)
	W0414 11:38:51.410687  808013 certs.go:480] ignoring /home/jenkins/minikube-integration/20534-594855/.minikube/certs/600227_empty.pem, impossibly tiny 0 bytes
	I0414 11:38:51.410714  808013 certs.go:484] found cert: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca-key.pem (1675 bytes)
	I0414 11:38:51.410779  808013 certs.go:484] found cert: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca.pem (1082 bytes)
	I0414 11:38:51.410848  808013 certs.go:484] found cert: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/cert.pem (1123 bytes)
	I0414 11:38:51.410893  808013 certs.go:484] found cert: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/key.pem (1675 bytes)
	I0414 11:38:51.410972  808013 certs.go:484] found cert: /home/jenkins/minikube-integration/20534-594855/.minikube/files/etc/ssl/certs/6002272.pem (1708 bytes)
	I0414 11:38:51.411790  808013 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0414 11:38:51.471115  808013 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0414 11:38:51.517768  808013 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0414 11:38:51.579245  808013 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0414 11:38:51.627901  808013 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I0414 11:38:51.684070  808013 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0414 11:38:51.711342  808013 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0414 11:38:51.735419  808013 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0414 11:38:51.772140  808013 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/certs/600227.pem --> /usr/share/ca-certificates/600227.pem (1338 bytes)
	I0414 11:38:51.808313  808013 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/files/etc/ssl/certs/6002272.pem --> /usr/share/ca-certificates/6002272.pem (1708 bytes)
	I0414 11:38:51.836778  808013 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0414 11:38:51.865639  808013 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0414 11:38:51.889266  808013 ssh_runner.go:195] Run: openssl version
	I0414 11:38:51.895716  808013 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/600227.pem && ln -fs /usr/share/ca-certificates/600227.pem /etc/ssl/certs/600227.pem"
	I0414 11:38:51.905240  808013 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/600227.pem
	I0414 11:38:51.909241  808013 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 14 11:01 /usr/share/ca-certificates/600227.pem
	I0414 11:38:51.909346  808013 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/600227.pem
	I0414 11:38:51.916731  808013 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/600227.pem /etc/ssl/certs/51391683.0"
	I0414 11:38:51.925763  808013 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6002272.pem && ln -fs /usr/share/ca-certificates/6002272.pem /etc/ssl/certs/6002272.pem"
	I0414 11:38:51.935498  808013 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6002272.pem
	I0414 11:38:51.939269  808013 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 14 11:01 /usr/share/ca-certificates/6002272.pem
	I0414 11:38:51.939334  808013 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6002272.pem
	I0414 11:38:51.946728  808013 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/6002272.pem /etc/ssl/certs/3ec20f2e.0"
	I0414 11:38:51.955390  808013 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0414 11:38:51.964636  808013 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0414 11:38:51.968731  808013 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 14 10:53 /usr/share/ca-certificates/minikubeCA.pem
	I0414 11:38:51.968844  808013 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0414 11:38:51.976505  808013 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0414 11:38:51.985289  808013 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0414 11:38:51.989321  808013 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0414 11:38:51.996457  808013 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0414 11:38:52.003525  808013 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0414 11:38:52.011100  808013 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0414 11:38:52.019192  808013 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0414 11:38:52.026986  808013 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0414 11:38:52.034651  808013 kubeadm.go:392] StartCluster: {Name:old-k8s-version-943255 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-943255 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0414 11:38:52.034746  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0414 11:38:52.034816  808013 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0414 11:38:52.086022  808013 cri.go:89] found id: "33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507"
	I0414 11:38:52.086054  808013 cri.go:89] found id: "e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265"
	I0414 11:38:52.086059  808013 cri.go:89] found id: "633cdeb29e1cced2a8a92f20652a9a137643be3320a89f7ceee43c47e8e2069f"
	I0414 11:38:52.086063  808013 cri.go:89] found id: "13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1"
	I0414 11:38:52.086066  808013 cri.go:89] found id: "dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c"
	I0414 11:38:52.086070  808013 cri.go:89] found id: "461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42"
	I0414 11:38:52.086073  808013 cri.go:89] found id: "d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6"
	I0414 11:38:52.086078  808013 cri.go:89] found id: "f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993"
	I0414 11:38:52.086081  808013 cri.go:89] found id: ""
	I0414 11:38:52.086134  808013 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	W0414 11:38:52.101485  808013 kubeadm.go:399] unpause failed: list paused: runc: sudo runc --root /run/containerd/runc/k8s.io list -f json: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-04-14T11:38:52Z" level=error msg="open /run/containerd/runc/k8s.io: no such file or directory"
	I0414 11:38:52.101623  808013 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0414 11:38:52.112426  808013 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0414 11:38:52.112510  808013 kubeadm.go:593] restartPrimaryControlPlane start ...
	I0414 11:38:52.112592  808013 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0414 11:38:52.121490  808013 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0414 11:38:52.122020  808013 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-943255" does not appear in /home/jenkins/minikube-integration/20534-594855/kubeconfig
	I0414 11:38:52.122199  808013 kubeconfig.go:62] /home/jenkins/minikube-integration/20534-594855/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-943255" cluster setting kubeconfig missing "old-k8s-version-943255" context setting]
	I0414 11:38:52.122530  808013 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20534-594855/kubeconfig: {Name:mk8e574788d73630fd9a80d8b6d7020d3ea20230 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0414 11:38:52.124053  808013 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0414 11:38:52.133871  808013 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
	I0414 11:38:52.133942  808013 kubeadm.go:597] duration metric: took 21.413164ms to restartPrimaryControlPlane
	I0414 11:38:52.133965  808013 kubeadm.go:394] duration metric: took 99.324317ms to StartCluster
	I0414 11:38:52.134007  808013 settings.go:142] acquiring lock: {Name:mk5ddbf5a28031cc72064a243fbaf01b8b1bb102 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0414 11:38:52.134094  808013 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20534-594855/kubeconfig
	I0414 11:38:52.134742  808013 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20534-594855/kubeconfig: {Name:mk8e574788d73630fd9a80d8b6d7020d3ea20230 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0414 11:38:52.134995  808013 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0414 11:38:52.135380  808013 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0414 11:38:52.135451  808013 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-943255"
	I0414 11:38:52.135465  808013 addons.go:238] Setting addon storage-provisioner=true in "old-k8s-version-943255"
	W0414 11:38:52.135471  808013 addons.go:247] addon storage-provisioner should already be in state true
	I0414 11:38:52.135492  808013 host.go:66] Checking if "old-k8s-version-943255" exists ...
	I0414 11:38:52.136138  808013 cli_runner.go:164] Run: docker container inspect old-k8s-version-943255 --format={{.State.Status}}
	I0414 11:38:52.136510  808013 config.go:182] Loaded profile config "old-k8s-version-943255": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0414 11:38:52.136628  808013 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-943255"
	I0414 11:38:52.136657  808013 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-943255"
	I0414 11:38:52.136956  808013 cli_runner.go:164] Run: docker container inspect old-k8s-version-943255 --format={{.State.Status}}
	I0414 11:38:52.137499  808013 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-943255"
	I0414 11:38:52.137531  808013 addons.go:238] Setting addon metrics-server=true in "old-k8s-version-943255"
	W0414 11:38:52.137538  808013 addons.go:247] addon metrics-server should already be in state true
	I0414 11:38:52.137566  808013 host.go:66] Checking if "old-k8s-version-943255" exists ...
	I0414 11:38:52.138008  808013 cli_runner.go:164] Run: docker container inspect old-k8s-version-943255 --format={{.State.Status}}
	I0414 11:38:52.141111  808013 addons.go:69] Setting dashboard=true in profile "old-k8s-version-943255"
	I0414 11:38:52.141318  808013 addons.go:238] Setting addon dashboard=true in "old-k8s-version-943255"
	W0414 11:38:52.141444  808013 addons.go:247] addon dashboard should already be in state true
	I0414 11:38:52.141660  808013 host.go:66] Checking if "old-k8s-version-943255" exists ...
	I0414 11:38:52.141283  808013 out.go:177] * Verifying Kubernetes components...
	I0414 11:38:52.144675  808013 cli_runner.go:164] Run: docker container inspect old-k8s-version-943255 --format={{.State.Status}}
	I0414 11:38:52.149125  808013 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0414 11:38:52.183370  808013 out.go:177]   - Using image fake.domain/registry.k8s.io/echoserver:1.4
	I0414 11:38:52.188866  808013 addons.go:435] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0414 11:38:52.188903  808013 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0414 11:38:52.188984  808013 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-943255
	I0414 11:38:52.219528  808013 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0414 11:38:52.225569  808013 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0414 11:38:52.225595  808013 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0414 11:38:52.225666  808013 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-943255
	I0414 11:38:52.233151  808013 addons.go:238] Setting addon default-storageclass=true in "old-k8s-version-943255"
	W0414 11:38:52.233173  808013 addons.go:247] addon default-storageclass should already be in state true
	I0414 11:38:52.233198  808013 host.go:66] Checking if "old-k8s-version-943255" exists ...
	I0414 11:38:52.233604  808013 cli_runner.go:164] Run: docker container inspect old-k8s-version-943255 --format={{.State.Status}}
	I0414 11:38:52.241042  808013 out.go:177]   - Using image docker.io/kubernetesui/dashboard:v2.7.0
	I0414 11:38:52.246972  808013 out.go:177]   - Using image registry.k8s.io/echoserver:1.4
	I0414 11:38:52.249761  808013 addons.go:435] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0414 11:38:52.249794  808013 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0414 11:38:52.249871  808013 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-943255
	I0414 11:38:52.253971  808013 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33806 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/old-k8s-version-943255/id_rsa Username:docker}
	I0414 11:38:52.277134  808013 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33806 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/old-k8s-version-943255/id_rsa Username:docker}
	I0414 11:38:52.291727  808013 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
	I0414 11:38:52.291753  808013 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0414 11:38:52.291814  808013 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-943255
	I0414 11:38:52.312089  808013 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33806 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/old-k8s-version-943255/id_rsa Username:docker}
	I0414 11:38:52.334982  808013 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33806 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/old-k8s-version-943255/id_rsa Username:docker}
	I0414 11:38:52.379307  808013 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0414 11:38:52.428489  808013 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-943255" to be "Ready" ...
	I0414 11:38:52.466835  808013 addons.go:435] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0414 11:38:52.466904  808013 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
	I0414 11:38:52.509398  808013 addons.go:435] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0414 11:38:52.509471  808013 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0414 11:38:52.515320  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0414 11:38:52.529703  808013 addons.go:435] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0414 11:38:52.529804  808013 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0414 11:38:52.541805  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0414 11:38:52.595809  808013 addons.go:435] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0414 11:38:52.595889  808013 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0414 11:38:52.607001  808013 addons.go:435] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0414 11:38:52.607081  808013 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0414 11:38:52.680995  808013 addons.go:435] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0414 11:38:52.681071  808013 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0414 11:38:52.736877  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0414 11:38:52.757687  808013 addons.go:435] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0414 11:38:52.757753  808013 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
	I0414 11:38:52.787036  808013 addons.go:435] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0414 11:38:52.787108  808013 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	W0414 11:38:52.796925  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:52.797015  808013 retry.go:31] will retry after 259.506457ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0414 11:38:52.797070  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:52.797095  808013 retry.go:31] will retry after 286.16206ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:52.814322  808013 addons.go:435] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0414 11:38:52.814398  808013 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0414 11:38:52.839276  808013 addons.go:435] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0414 11:38:52.839351  808013 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0414 11:38:52.863440  808013 addons.go:435] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0414 11:38:52.863519  808013 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	W0414 11:38:52.880553  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:52.880646  808013 retry.go:31] will retry after 163.313455ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:52.884771  808013 addons.go:435] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0414 11:38:52.884830  808013 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0414 11:38:52.902148  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0414 11:38:52.978913  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:52.978957  808013 retry.go:31] will retry after 268.671217ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:53.045150  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0414 11:38:53.056867  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0414 11:38:53.084222  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0414 11:38:53.212647  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:53.212690  808013 retry.go:31] will retry after 499.358853ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0414 11:38:53.233608  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:53.233641  808013 retry.go:31] will retry after 316.801707ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:53.247946  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0414 11:38:53.274577  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:53.274614  808013 retry.go:31] will retry after 494.720987ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0414 11:38:53.377329  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:53.377365  808013 retry.go:31] will retry after 474.64825ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:53.551169  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0414 11:38:53.658339  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:53.658380  808013 retry.go:31] will retry after 732.232568ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:53.712936  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0414 11:38:53.770329  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0414 11:38:53.803840  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:53.803917  808013 retry.go:31] will retry after 801.462029ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:53.852856  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0414 11:38:53.853650  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:53.853676  808013 retry.go:31] will retry after 572.996066ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0414 11:38:53.928514  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:53.928591  808013 retry.go:31] will retry after 609.676233ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:54.391106  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0414 11:38:54.427499  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0414 11:38:54.428991  808013 node_ready.go:53] error getting node "old-k8s-version-943255": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-943255": dial tcp 192.168.76.2:8443: connect: connection refused
	I0414 11:38:54.538614  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0414 11:38:54.540738  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:54.540807  808013 retry.go:31] will retry after 961.335993ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:54.606356  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0414 11:38:54.612355  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:54.612426  808013 retry.go:31] will retry after 663.067721ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0414 11:38:54.726519  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:54.726597  808013 retry.go:31] will retry after 560.1256ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0414 11:38:54.776315  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:54.776344  808013 retry.go:31] will retry after 904.343794ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:55.276433  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0414 11:38:55.287671  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0414 11:38:55.367266  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:55.367304  808013 retry.go:31] will retry after 1.387206086s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0414 11:38:55.387666  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:55.387742  808013 retry.go:31] will retry after 1.190200388s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:55.502381  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0414 11:38:55.574511  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:55.574542  808013 retry.go:31] will retry after 1.681205788s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:55.681719  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0414 11:38:55.759631  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:55.759657  808013 retry.go:31] will retry after 1.491669616s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:56.429068  808013 node_ready.go:53] error getting node "old-k8s-version-943255": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-943255": dial tcp 192.168.76.2:8443: connect: connection refused
	I0414 11:38:56.578471  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0414 11:38:56.667715  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:56.667743  808013 retry.go:31] will retry after 2.059465904s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:56.755082  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0414 11:38:56.832152  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:56.832183  808013 retry.go:31] will retry after 1.569713844s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:57.252212  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0414 11:38:57.256454  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0414 11:38:57.355004  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:57.355038  808013 retry.go:31] will retry after 2.786778491s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0414 11:38:57.365166  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:57.365196  808013 retry.go:31] will retry after 2.006776097s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:58.402085  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0414 11:38:58.429704  808013 node_ready.go:53] error getting node "old-k8s-version-943255": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-943255": dial tcp 192.168.76.2:8443: connect: connection refused
	W0414 11:38:58.481205  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:58.481236  808013 retry.go:31] will retry after 3.642911382s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:58.727952  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0414 11:38:58.839429  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:58.839459  808013 retry.go:31] will retry after 3.12561263s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:59.375248  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0414 11:38:59.539000  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:38:59.539026  808013 retry.go:31] will retry after 1.773862056s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:39:00.142359  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0414 11:39:00.361323  808013 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:39:00.361351  808013 retry.go:31] will retry after 2.033911814s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0414 11:39:00.429898  808013 node_ready.go:53] error getting node "old-k8s-version-943255": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-943255": dial tcp 192.168.76.2:8443: connect: connection refused
	I0414 11:39:01.313497  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0414 11:39:01.965601  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0414 11:39:02.125032  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0414 11:39:02.395462  808013 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0414 11:39:09.912872  808013 node_ready.go:49] node "old-k8s-version-943255" has status "Ready":"True"
	I0414 11:39:09.912896  808013 node_ready.go:38] duration metric: took 17.484370269s for node "old-k8s-version-943255" to be "Ready" ...
	I0414 11:39:09.912906  808013 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0414 11:39:10.053957  808013 pod_ready.go:79] waiting up to 6m0s for pod "coredns-74ff55c5b-b6hq8" in "kube-system" namespace to be "Ready" ...
	I0414 11:39:10.123631  808013 pod_ready.go:93] pod "coredns-74ff55c5b-b6hq8" in "kube-system" namespace has status "Ready":"True"
	I0414 11:39:10.123707  808013 pod_ready.go:82] duration metric: took 69.668379ms for pod "coredns-74ff55c5b-b6hq8" in "kube-system" namespace to be "Ready" ...
	I0414 11:39:10.123733  808013 pod_ready.go:79] waiting up to 6m0s for pod "etcd-old-k8s-version-943255" in "kube-system" namespace to be "Ready" ...
	I0414 11:39:10.496189  808013 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (9.182646909s)
	I0414 11:39:11.020706  808013 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (8.89564027s)
	I0414 11:39:11.020808  808013 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.625321086s)
	I0414 11:39:11.020826  808013 addons.go:479] Verifying addon metrics-server=true in "old-k8s-version-943255"
	I0414 11:39:11.020895  808013 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (9.05526104s)
	I0414 11:39:11.024187  808013 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p old-k8s-version-943255 addons enable metrics-server
	
	I0414 11:39:11.027222  808013 out.go:177] * Enabled addons: default-storageclass, storage-provisioner, metrics-server, dashboard
	I0414 11:39:11.030384  808013 addons.go:514] duration metric: took 18.89500572s for enable addons: enabled=[default-storageclass storage-provisioner metrics-server dashboard]
	I0414 11:39:12.129143  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:14.628666  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:16.628804  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:18.631534  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:21.129074  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:23.129452  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:25.634097  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:28.139472  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:30.629224  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:32.657591  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:35.129715  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:37.130571  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:39.635384  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:42.130130  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:44.629688  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:47.128548  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:49.129514  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:51.628798  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:53.630319  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:55.630788  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:39:57.630848  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:00.134139  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:02.628606  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:04.629534  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:07.129295  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:09.129380  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:11.129871  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:13.130721  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:15.135363  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:17.135479  808013 pod_ready.go:103] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:18.629889  808013 pod_ready.go:93] pod "etcd-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"True"
	I0414 11:40:18.629911  808013 pod_ready.go:82] duration metric: took 1m8.506157324s for pod "etcd-old-k8s-version-943255" in "kube-system" namespace to be "Ready" ...
	I0414 11:40:18.629925  808013 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-943255" in "kube-system" namespace to be "Ready" ...
	I0414 11:40:18.633596  808013 pod_ready.go:93] pod "kube-apiserver-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"True"
	I0414 11:40:18.633617  808013 pod_ready.go:82] duration metric: took 3.68437ms for pod "kube-apiserver-old-k8s-version-943255" in "kube-system" namespace to be "Ready" ...
	I0414 11:40:18.633627  808013 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-943255" in "kube-system" namespace to be "Ready" ...
	I0414 11:40:20.638714  808013 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:22.639737  808013 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:25.138533  808013 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:27.638868  808013 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:30.138465  808013 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:32.138818  808013 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:34.638833  808013 pod_ready.go:103] pod "kube-controller-manager-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:35.638572  808013 pod_ready.go:93] pod "kube-controller-manager-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"True"
	I0414 11:40:35.638596  808013 pod_ready.go:82] duration metric: took 17.004960705s for pod "kube-controller-manager-old-k8s-version-943255" in "kube-system" namespace to be "Ready" ...
	I0414 11:40:35.638609  808013 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-rhrdw" in "kube-system" namespace to be "Ready" ...
	I0414 11:40:35.642347  808013 pod_ready.go:93] pod "kube-proxy-rhrdw" in "kube-system" namespace has status "Ready":"True"
	I0414 11:40:35.642371  808013 pod_ready.go:82] duration metric: took 3.754023ms for pod "kube-proxy-rhrdw" in "kube-system" namespace to be "Ready" ...
	I0414 11:40:35.642381  808013 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-943255" in "kube-system" namespace to be "Ready" ...
	I0414 11:40:35.645705  808013 pod_ready.go:93] pod "kube-scheduler-old-k8s-version-943255" in "kube-system" namespace has status "Ready":"True"
	I0414 11:40:35.645725  808013 pod_ready.go:82] duration metric: took 3.336411ms for pod "kube-scheduler-old-k8s-version-943255" in "kube-system" namespace to be "Ready" ...
	I0414 11:40:35.645735  808013 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace to be "Ready" ...
	I0414 11:40:37.650745  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:40.149640  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:42.166268  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:44.650556  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:46.651533  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:48.651569  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:51.150455  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:53.152034  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:55.651125  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:40:58.150867  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:00.151815  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:02.650682  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:04.650974  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:07.150265  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:09.150952  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:11.650526  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:13.651509  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:15.653052  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:18.150472  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:20.151319  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:22.650266  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:24.650303  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:27.151056  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:29.655451  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:32.150746  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:34.150903  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:36.151442  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:38.652966  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:41.150222  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:43.150852  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:45.151678  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:47.650935  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:49.651078  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:52.151182  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:54.657844  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:57.151407  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:41:59.650744  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:01.651558  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:04.151046  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:06.650623  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:08.650785  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:11.151086  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:13.151819  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:15.652882  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:18.151069  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:20.650640  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:22.651504  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:25.150947  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:27.154835  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:29.650802  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:31.652345  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:34.150804  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:36.650485  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:38.651491  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:41.150777  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:43.650621  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:45.650891  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:48.150428  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:50.151431  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:52.650830  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:54.652615  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:57.149717  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:42:59.150687  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:01.650201  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:03.650857  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:06.150398  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:08.150788  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:10.151466  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:12.651872  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:15.150724  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:17.650842  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:19.650918  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:21.732789  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:24.150687  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:26.151587  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:28.650883  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:30.651282  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:32.652045  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:34.652676  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:36.655943  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:39.151298  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:41.650977  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:43.652052  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:46.150449  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:48.150575  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:50.150951  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:52.150985  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:54.650962  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:56.651439  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:43:59.150723  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:01.151026  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:03.151379  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:05.650815  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:07.652079  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:10.150936  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:12.213829  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:14.651279  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:17.151326  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:19.151681  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:21.650607  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:23.651001  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:25.651703  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:27.651830  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:29.652576  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:32.152298  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:34.152828  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:35.645880  808013 pod_ready.go:82] duration metric: took 4m0.000127627s for pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace to be "Ready" ...
	E0414 11:44:35.645914  808013 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
	I0414 11:44:35.645924  808013 pod_ready.go:39] duration metric: took 5m25.733004506s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0414 11:44:35.645943  808013 api_server.go:52] waiting for apiserver process to appear ...
	I0414 11:44:35.645987  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0414 11:44:35.646052  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0414 11:44:35.707213  808013 cri.go:89] found id: "e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8"
	I0414 11:44:35.707232  808013 cri.go:89] found id: "461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42"
	I0414 11:44:35.707238  808013 cri.go:89] found id: ""
	I0414 11:44:35.707246  808013 logs.go:282] 2 containers: [e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8 461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42]
	I0414 11:44:35.707300  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.711354  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.714967  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0414 11:44:35.715030  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0414 11:44:35.764599  808013 cri.go:89] found id: "22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29"
	I0414 11:44:35.764619  808013 cri.go:89] found id: "dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c"
	I0414 11:44:35.764624  808013 cri.go:89] found id: ""
	I0414 11:44:35.764631  808013 logs.go:282] 2 containers: [22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29 dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c]
	I0414 11:44:35.764691  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.769219  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.773412  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0414 11:44:35.773552  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0414 11:44:35.822306  808013 cri.go:89] found id: "0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1"
	I0414 11:44:35.822385  808013 cri.go:89] found id: "33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507"
	I0414 11:44:35.822405  808013 cri.go:89] found id: ""
	I0414 11:44:35.822429  808013 logs.go:282] 2 containers: [0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1 33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507]
	I0414 11:44:35.822547  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.830286  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.835154  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0414 11:44:35.835274  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0414 11:44:35.918515  808013 cri.go:89] found id: "1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e"
	I0414 11:44:35.918538  808013 cri.go:89] found id: "f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993"
	I0414 11:44:35.918543  808013 cri.go:89] found id: ""
	I0414 11:44:35.918550  808013 logs.go:282] 2 containers: [1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993]
	I0414 11:44:35.918605  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.922874  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.926497  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0414 11:44:35.926568  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0414 11:44:35.968096  808013 cri.go:89] found id: "79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803"
	I0414 11:44:35.968115  808013 cri.go:89] found id: "13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1"
	I0414 11:44:35.968121  808013 cri.go:89] found id: ""
	I0414 11:44:35.968129  808013 logs.go:282] 2 containers: [79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803 13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1]
	I0414 11:44:35.968182  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.972186  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.976008  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0414 11:44:35.976077  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0414 11:44:36.027663  808013 cri.go:89] found id: "2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6"
	I0414 11:44:36.027688  808013 cri.go:89] found id: "d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6"
	I0414 11:44:36.027695  808013 cri.go:89] found id: ""
	I0414 11:44:36.027702  808013 logs.go:282] 2 containers: [2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6 d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6]
	I0414 11:44:36.027763  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:36.032426  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:36.036295  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I0414 11:44:36.036366  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0414 11:44:36.118257  808013 cri.go:89] found id: "54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d"
	I0414 11:44:36.118281  808013 cri.go:89] found id: "e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265"
	I0414 11:44:36.118286  808013 cri.go:89] found id: ""
	I0414 11:44:36.118293  808013 logs.go:282] 2 containers: [54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265]
	I0414 11:44:36.118353  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:36.122642  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:36.127259  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0414 11:44:36.127347  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0414 11:44:36.174126  808013 cri.go:89] found id: "e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa"
	I0414 11:44:36.174145  808013 cri.go:89] found id: "daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9"
	I0414 11:44:36.174150  808013 cri.go:89] found id: ""
	I0414 11:44:36.174158  808013 logs.go:282] 2 containers: [e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9]
	I0414 11:44:36.174218  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:36.178084  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:36.181804  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0414 11:44:36.181872  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0414 11:44:36.251384  808013 cri.go:89] found id: "59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566"
	I0414 11:44:36.251408  808013 cri.go:89] found id: ""
	I0414 11:44:36.251416  808013 logs.go:282] 1 containers: [59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566]
	I0414 11:44:36.251473  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:36.255371  808013 logs.go:123] Gathering logs for dmesg ...
	I0414 11:44:36.255396  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0414 11:44:36.272452  808013 logs.go:123] Gathering logs for etcd [dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c] ...
	I0414 11:44:36.272478  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c"
	I0414 11:44:36.330279  808013 logs.go:123] Gathering logs for kube-scheduler [1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e] ...
	I0414 11:44:36.330308  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e"
	I0414 11:44:36.383084  808013 logs.go:123] Gathering logs for kube-proxy [79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803] ...
	I0414 11:44:36.383113  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803"
	I0414 11:44:36.442830  808013 logs.go:123] Gathering logs for storage-provisioner [e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa] ...
	I0414 11:44:36.442858  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa"
	I0414 11:44:36.495051  808013 logs.go:123] Gathering logs for container status ...
	I0414 11:44:36.495079  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0414 11:44:36.544394  808013 logs.go:123] Gathering logs for describe nodes ...
	I0414 11:44:36.544425  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0414 11:44:36.779585  808013 logs.go:123] Gathering logs for coredns [0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1] ...
	I0414 11:44:36.779619  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1"
	I0414 11:44:36.826566  808013 logs.go:123] Gathering logs for kube-controller-manager [2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6] ...
	I0414 11:44:36.826591  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6"
	I0414 11:44:36.900218  808013 logs.go:123] Gathering logs for storage-provisioner [daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9] ...
	I0414 11:44:36.900315  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9"
	I0414 11:44:36.958930  808013 logs.go:123] Gathering logs for kube-apiserver [e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8] ...
	I0414 11:44:36.958961  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8"
	I0414 11:44:37.042579  808013 logs.go:123] Gathering logs for etcd [22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29] ...
	I0414 11:44:37.042697  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29"
	I0414 11:44:37.116857  808013 logs.go:123] Gathering logs for kube-proxy [13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1] ...
	I0414 11:44:37.117086  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1"
	I0414 11:44:37.179108  808013 logs.go:123] Gathering logs for kube-controller-manager [d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6] ...
	I0414 11:44:37.179189  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6"
	I0414 11:44:37.253469  808013 logs.go:123] Gathering logs for kindnet [e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265] ...
	I0414 11:44:37.253548  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265"
	I0414 11:44:37.324129  808013 logs.go:123] Gathering logs for containerd ...
	I0414 11:44:37.324153  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0414 11:44:37.396825  808013 logs.go:123] Gathering logs for kubelet ...
	I0414 11:44:37.396907  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0414 11:44:37.459287  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.671664     661 reflector.go:138] object-"kube-system"/"kube-proxy-token-f29ww": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-f29ww" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.459575  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.678711     661 reflector.go:138] object-"kube-system"/"kindnet-token-srz8d": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-srz8d" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.459824  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.679945     661 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.460067  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.681204     661 reflector.go:138] object-"kube-system"/"coredns-token-lkmz8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-lkmz8" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.460320  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.681667     661 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.460557  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.689142     661 reflector.go:138] object-"default"/"default-token-6r6dc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-6r6dc" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.464420  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.710198     661 reflector.go:138] object-"kube-system"/"storage-provisioner-token-cbmxs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-cbmxs" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.464698  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.823295     661 reflector.go:138] object-"kube-system"/"metrics-server-token-9hmzl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-9hmzl" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.472775  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:12 old-k8s-version-943255 kubelet[661]: E0414 11:39:12.493034     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:37.473017  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:12 old-k8s-version-943255 kubelet[661]: E0414 11:39:12.517194     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.475829  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:27 old-k8s-version-943255 kubelet[661]: E0414 11:39:27.201995     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:37.478046  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:34 old-k8s-version-943255 kubelet[661]: E0414 11:39:34.614078     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.478423  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:35 old-k8s-version-943255 kubelet[661]: E0414 11:39:35.636481     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.478777  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:36 old-k8s-version-943255 kubelet[661]: E0414 11:39:36.642188     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.478985  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:39 old-k8s-version-943255 kubelet[661]: E0414 11:39:39.192063     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.479803  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:42 old-k8s-version-943255 kubelet[661]: E0414 11:39:42.656633     661 pod_workers.go:191] Error syncing pod 70b78d06-fcec-4cd3-9143-9c2bd9176c52 ("storage-provisioner_kube-system(70b78d06-fcec-4cd3-9143-9c2bd9176c52)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(70b78d06-fcec-4cd3-9143-9c2bd9176c52)"
	W0414 11:44:37.480421  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:47 old-k8s-version-943255 kubelet[661]: E0414 11:39:47.688060     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.485301  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:54 old-k8s-version-943255 kubelet[661]: E0414 11:39:54.213195     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:37.485704  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:55 old-k8s-version-943255 kubelet[661]: E0414 11:39:55.053328     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.486062  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:09 old-k8s-version-943255 kubelet[661]: E0414 11:40:09.192116     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.486679  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:10 old-k8s-version-943255 kubelet[661]: E0414 11:40:10.769424     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.487042  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:15 old-k8s-version-943255 kubelet[661]: E0414 11:40:15.053424     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.487261  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:24 old-k8s-version-943255 kubelet[661]: E0414 11:40:24.192449     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.487611  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:27 old-k8s-version-943255 kubelet[661]: E0414 11:40:27.191843     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.490088  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:38 old-k8s-version-943255 kubelet[661]: E0414 11:40:38.205282     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:37.490441  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:39 old-k8s-version-943255 kubelet[661]: E0414 11:40:39.191989     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.490650  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:49 old-k8s-version-943255 kubelet[661]: E0414 11:40:49.192230     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.491273  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:53 old-k8s-version-943255 kubelet[661]: E0414 11:40:53.882336     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.491633  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:55 old-k8s-version-943255 kubelet[661]: E0414 11:40:55.053117     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.491842  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:02 old-k8s-version-943255 kubelet[661]: E0414 11:41:02.195946     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.492237  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:06 old-k8s-version-943255 kubelet[661]: E0414 11:41:06.191978     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.492502  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:13 old-k8s-version-943255 kubelet[661]: E0414 11:41:13.192235     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.492862  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:21 old-k8s-version-943255 kubelet[661]: E0414 11:41:21.191820     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.493305  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:25 old-k8s-version-943255 kubelet[661]: E0414 11:41:25.192141     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.493673  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:34 old-k8s-version-943255 kubelet[661]: E0414 11:41:34.191786     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.493892  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:39 old-k8s-version-943255 kubelet[661]: E0414 11:41:39.192207     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.494265  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:47 old-k8s-version-943255 kubelet[661]: E0414 11:41:47.191837     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.494510  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:52 old-k8s-version-943255 kubelet[661]: E0414 11:41:52.194045     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.494865  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:00 old-k8s-version-943255 kubelet[661]: E0414 11:42:00.196599     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.497330  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:04 old-k8s-version-943255 kubelet[661]: E0414 11:42:04.200603     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:37.497985  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:16 old-k8s-version-943255 kubelet[661]: E0414 11:42:16.072747     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.498194  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:18 old-k8s-version-943255 kubelet[661]: E0414 11:42:18.200708     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.498551  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:25 old-k8s-version-943255 kubelet[661]: E0414 11:42:25.053597     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.498765  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:30 old-k8s-version-943255 kubelet[661]: E0414 11:42:30.192906     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.499164  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:37 old-k8s-version-943255 kubelet[661]: E0414 11:42:37.192466     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.499401  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:41 old-k8s-version-943255 kubelet[661]: E0414 11:42:41.192467     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.499793  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:49 old-k8s-version-943255 kubelet[661]: E0414 11:42:49.191798     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.500002  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:52 old-k8s-version-943255 kubelet[661]: E0414 11:42:52.192457     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.500398  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:01 old-k8s-version-943255 kubelet[661]: E0414 11:43:01.191833     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.500634  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:04 old-k8s-version-943255 kubelet[661]: E0414 11:43:04.193465     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.500989  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:13 old-k8s-version-943255 kubelet[661]: E0414 11:43:13.191790     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.501207  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:19 old-k8s-version-943255 kubelet[661]: E0414 11:43:19.192065     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.501566  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:25 old-k8s-version-943255 kubelet[661]: E0414 11:43:25.191821     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.501786  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:33 old-k8s-version-943255 kubelet[661]: E0414 11:43:33.192850     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.502138  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:39 old-k8s-version-943255 kubelet[661]: E0414 11:43:39.191923     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.502347  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:48 old-k8s-version-943255 kubelet[661]: E0414 11:43:48.192882     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.502694  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:54 old-k8s-version-943255 kubelet[661]: E0414 11:43:54.192005     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.502902  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:59 old-k8s-version-943255 kubelet[661]: E0414 11:43:59.193181     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.503257  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:05 old-k8s-version-943255 kubelet[661]: E0414 11:44:05.192322     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.503464  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:11 old-k8s-version-943255 kubelet[661]: E0414 11:44:11.192365     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.503864  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:16 old-k8s-version-943255 kubelet[661]: E0414 11:44:16.192478     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.504075  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:23 old-k8s-version-943255 kubelet[661]: E0414 11:44:23.192167     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.504438  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:29 old-k8s-version-943255 kubelet[661]: E0414 11:44:29.194021     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.504652  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:37 old-k8s-version-943255 kubelet[661]: E0414 11:44:37.193029     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I0414 11:44:37.504678  808013 logs.go:123] Gathering logs for kube-apiserver [461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42] ...
	I0414 11:44:37.504708  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42"
	I0414 11:44:37.571239  808013 logs.go:123] Gathering logs for coredns [33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507] ...
	I0414 11:44:37.571325  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507"
	I0414 11:44:37.625288  808013 logs.go:123] Gathering logs for kube-scheduler [f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993] ...
	I0414 11:44:37.625358  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993"
	I0414 11:44:37.681927  808013 logs.go:123] Gathering logs for kindnet [54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d] ...
	I0414 11:44:37.681964  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d"
	I0414 11:44:37.744768  808013 logs.go:123] Gathering logs for kubernetes-dashboard [59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566] ...
	I0414 11:44:37.744804  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566"
	I0414 11:44:37.801721  808013 out.go:358] Setting ErrFile to fd 2...
	I0414 11:44:37.801748  808013 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W0414 11:44:37.801858  808013 out.go:270] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0414 11:44:37.801875  808013 out.go:270]   Apr 14 11:44:11 old-k8s-version-943255 kubelet[661]: E0414 11:44:11.192365     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Apr 14 11:44:11 old-k8s-version-943255 kubelet[661]: E0414 11:44:11.192365     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.801882  808013 out.go:270]   Apr 14 11:44:16 old-k8s-version-943255 kubelet[661]: E0414 11:44:16.192478     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	  Apr 14 11:44:16 old-k8s-version-943255 kubelet[661]: E0414 11:44:16.192478     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.801891  808013 out.go:270]   Apr 14 11:44:23 old-k8s-version-943255 kubelet[661]: E0414 11:44:23.192167     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Apr 14 11:44:23 old-k8s-version-943255 kubelet[661]: E0414 11:44:23.192167     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.802008  808013 out.go:270]   Apr 14 11:44:29 old-k8s-version-943255 kubelet[661]: E0414 11:44:29.194021     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	  Apr 14 11:44:29 old-k8s-version-943255 kubelet[661]: E0414 11:44:29.194021     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.802018  808013 out.go:270]   Apr 14 11:44:37 old-k8s-version-943255 kubelet[661]: E0414 11:44:37.193029     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Apr 14 11:44:37 old-k8s-version-943255 kubelet[661]: E0414 11:44:37.193029     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I0414 11:44:37.802024  808013 out.go:358] Setting ErrFile to fd 2...
	I0414 11:44:37.802031  808013 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:44:47.803431  808013 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0414 11:44:47.816139  808013 api_server.go:72] duration metric: took 5m55.681082464s to wait for apiserver process to appear ...
	I0414 11:44:47.816174  808013 api_server.go:88] waiting for apiserver healthz status ...
	I0414 11:44:47.816213  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0414 11:44:47.816268  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0414 11:44:47.872941  808013 cri.go:89] found id: "e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8"
	I0414 11:44:47.872961  808013 cri.go:89] found id: "461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42"
	I0414 11:44:47.872968  808013 cri.go:89] found id: ""
	I0414 11:44:47.872975  808013 logs.go:282] 2 containers: [e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8 461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42]
	I0414 11:44:47.873036  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:47.877393  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:47.881537  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0414 11:44:47.881608  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0414 11:44:47.951247  808013 cri.go:89] found id: "22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29"
	I0414 11:44:47.951266  808013 cri.go:89] found id: "dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c"
	I0414 11:44:47.951271  808013 cri.go:89] found id: ""
	I0414 11:44:47.951278  808013 logs.go:282] 2 containers: [22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29 dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c]
	I0414 11:44:47.951339  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:47.955570  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:47.960046  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0414 11:44:47.960114  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0414 11:44:48.016776  808013 cri.go:89] found id: "0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1"
	I0414 11:44:48.016798  808013 cri.go:89] found id: "33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507"
	I0414 11:44:48.016803  808013 cri.go:89] found id: ""
	I0414 11:44:48.016810  808013 logs.go:282] 2 containers: [0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1 33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507]
	I0414 11:44:48.016869  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.021594  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.026096  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0414 11:44:48.026187  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0414 11:44:48.078498  808013 cri.go:89] found id: "1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e"
	I0414 11:44:48.078570  808013 cri.go:89] found id: "f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993"
	I0414 11:44:48.078588  808013 cri.go:89] found id: ""
	I0414 11:44:48.078612  808013 logs.go:282] 2 containers: [1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993]
	I0414 11:44:48.078706  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.083758  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.088172  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0414 11:44:48.088249  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0414 11:44:48.137517  808013 cri.go:89] found id: "79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803"
	I0414 11:44:48.137536  808013 cri.go:89] found id: "13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1"
	I0414 11:44:48.137541  808013 cri.go:89] found id: ""
	I0414 11:44:48.137549  808013 logs.go:282] 2 containers: [79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803 13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1]
	I0414 11:44:48.137605  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.142443  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.146807  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0414 11:44:48.146876  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0414 11:44:48.211322  808013 cri.go:89] found id: "2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6"
	I0414 11:44:48.211341  808013 cri.go:89] found id: "d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6"
	I0414 11:44:48.211346  808013 cri.go:89] found id: ""
	I0414 11:44:48.211353  808013 logs.go:282] 2 containers: [2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6 d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6]
	I0414 11:44:48.211419  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.215344  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.220867  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I0414 11:44:48.220986  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0414 11:44:48.290792  808013 cri.go:89] found id: "54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d"
	I0414 11:44:48.290868  808013 cri.go:89] found id: "e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265"
	I0414 11:44:48.290888  808013 cri.go:89] found id: ""
	I0414 11:44:48.290909  808013 logs.go:282] 2 containers: [54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265]
	I0414 11:44:48.290995  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.294782  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.298559  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0414 11:44:48.298692  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0414 11:44:48.342392  808013 cri.go:89] found id: "e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa"
	I0414 11:44:48.342467  808013 cri.go:89] found id: "daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9"
	I0414 11:44:48.342485  808013 cri.go:89] found id: ""
	I0414 11:44:48.342507  808013 logs.go:282] 2 containers: [e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9]
	I0414 11:44:48.342598  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.346339  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.349761  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0414 11:44:48.349914  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0414 11:44:48.401259  808013 cri.go:89] found id: "59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566"
	I0414 11:44:48.401283  808013 cri.go:89] found id: ""
	I0414 11:44:48.401291  808013 logs.go:282] 1 containers: [59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566]
	I0414 11:44:48.401374  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.405041  808013 logs.go:123] Gathering logs for coredns [33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507] ...
	I0414 11:44:48.405061  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507"
	I0414 11:44:48.453766  808013 logs.go:123] Gathering logs for kube-controller-manager [d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6] ...
	I0414 11:44:48.453818  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6"
	I0414 11:44:48.531990  808013 logs.go:123] Gathering logs for kindnet [54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d] ...
	I0414 11:44:48.532069  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d"
	I0414 11:44:48.612437  808013 logs.go:123] Gathering logs for storage-provisioner [daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9] ...
	I0414 11:44:48.612515  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9"
	I0414 11:44:48.666338  808013 logs.go:123] Gathering logs for kube-apiserver [e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8] ...
	I0414 11:44:48.666414  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8"
	I0414 11:44:48.735137  808013 logs.go:123] Gathering logs for kube-apiserver [461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42] ...
	I0414 11:44:48.735212  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42"
	I0414 11:44:48.803249  808013 logs.go:123] Gathering logs for etcd [dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c] ...
	I0414 11:44:48.803325  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c"
	I0414 11:44:48.848323  808013 logs.go:123] Gathering logs for kube-proxy [79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803] ...
	I0414 11:44:48.848474  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803"
	I0414 11:44:48.915130  808013 logs.go:123] Gathering logs for kube-controller-manager [2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6] ...
	I0414 11:44:48.915200  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6"
	I0414 11:44:49.022893  808013 logs.go:123] Gathering logs for kindnet [e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265] ...
	I0414 11:44:49.022926  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265"
	I0414 11:44:49.095606  808013 logs.go:123] Gathering logs for kubernetes-dashboard [59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566] ...
	I0414 11:44:49.095676  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566"
	I0414 11:44:49.150412  808013 logs.go:123] Gathering logs for kubelet ...
	I0414 11:44:49.150492  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0414 11:44:49.229956  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.671664     661 reflector.go:138] object-"kube-system"/"kube-proxy-token-f29ww": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-f29ww" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.230231  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.678711     661 reflector.go:138] object-"kube-system"/"kindnet-token-srz8d": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-srz8d" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.230461  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.679945     661 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.230689  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.681204     661 reflector.go:138] object-"kube-system"/"coredns-token-lkmz8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-lkmz8" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.230907  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.681667     661 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.231134  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.689142     661 reflector.go:138] object-"default"/"default-token-6r6dc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-6r6dc" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.234893  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.710198     661 reflector.go:138] object-"kube-system"/"storage-provisioner-token-cbmxs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-cbmxs" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.235118  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.823295     661 reflector.go:138] object-"kube-system"/"metrics-server-token-9hmzl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-9hmzl" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.243126  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:12 old-k8s-version-943255 kubelet[661]: E0414 11:39:12.493034     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:49.243360  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:12 old-k8s-version-943255 kubelet[661]: E0414 11:39:12.517194     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.246196  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:27 old-k8s-version-943255 kubelet[661]: E0414 11:39:27.201995     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:49.248284  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:34 old-k8s-version-943255 kubelet[661]: E0414 11:39:34.614078     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.248631  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:35 old-k8s-version-943255 kubelet[661]: E0414 11:39:35.636481     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.249036  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:36 old-k8s-version-943255 kubelet[661]: E0414 11:39:36.642188     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.249240  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:39 old-k8s-version-943255 kubelet[661]: E0414 11:39:39.192063     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.250082  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:42 old-k8s-version-943255 kubelet[661]: E0414 11:39:42.656633     661 pod_workers.go:191] Error syncing pod 70b78d06-fcec-4cd3-9143-9c2bd9176c52 ("storage-provisioner_kube-system(70b78d06-fcec-4cd3-9143-9c2bd9176c52)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(70b78d06-fcec-4cd3-9143-9c2bd9176c52)"
	W0414 11:44:49.250700  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:47 old-k8s-version-943255 kubelet[661]: E0414 11:39:47.688060     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.253604  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:54 old-k8s-version-943255 kubelet[661]: E0414 11:39:54.213195     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:49.253942  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:55 old-k8s-version-943255 kubelet[661]: E0414 11:39:55.053328     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.254482  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:09 old-k8s-version-943255 kubelet[661]: E0414 11:40:09.192116     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.255118  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:10 old-k8s-version-943255 kubelet[661]: E0414 11:40:10.769424     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.255538  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:15 old-k8s-version-943255 kubelet[661]: E0414 11:40:15.053424     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.255724  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:24 old-k8s-version-943255 kubelet[661]: E0414 11:40:24.192449     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.256047  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:27 old-k8s-version-943255 kubelet[661]: E0414 11:40:27.191843     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.258929  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:38 old-k8s-version-943255 kubelet[661]: E0414 11:40:38.205282     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:49.259299  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:39 old-k8s-version-943255 kubelet[661]: E0414 11:40:39.191989     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.259508  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:49 old-k8s-version-943255 kubelet[661]: E0414 11:40:49.192230     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.260116  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:53 old-k8s-version-943255 kubelet[661]: E0414 11:40:53.882336     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.260460  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:55 old-k8s-version-943255 kubelet[661]: E0414 11:40:55.053117     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.260682  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:02 old-k8s-version-943255 kubelet[661]: E0414 11:41:02.195946     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.261040  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:06 old-k8s-version-943255 kubelet[661]: E0414 11:41:06.191978     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.261245  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:13 old-k8s-version-943255 kubelet[661]: E0414 11:41:13.192235     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.261591  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:21 old-k8s-version-943255 kubelet[661]: E0414 11:41:21.191820     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.261806  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:25 old-k8s-version-943255 kubelet[661]: E0414 11:41:25.192141     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.262151  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:34 old-k8s-version-943255 kubelet[661]: E0414 11:41:34.191786     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.262353  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:39 old-k8s-version-943255 kubelet[661]: E0414 11:41:39.192207     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.262702  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:47 old-k8s-version-943255 kubelet[661]: E0414 11:41:47.191837     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.262902  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:52 old-k8s-version-943255 kubelet[661]: E0414 11:41:52.194045     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.263247  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:00 old-k8s-version-943255 kubelet[661]: E0414 11:42:00.196599     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.265879  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:04 old-k8s-version-943255 kubelet[661]: E0414 11:42:04.200603     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:49.266542  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:16 old-k8s-version-943255 kubelet[661]: E0414 11:42:16.072747     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.266749  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:18 old-k8s-version-943255 kubelet[661]: E0414 11:42:18.200708     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.267094  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:25 old-k8s-version-943255 kubelet[661]: E0414 11:42:25.053597     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.267293  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:30 old-k8s-version-943255 kubelet[661]: E0414 11:42:30.192906     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.267657  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:37 old-k8s-version-943255 kubelet[661]: E0414 11:42:37.192466     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.267861  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:41 old-k8s-version-943255 kubelet[661]: E0414 11:42:41.192467     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.268203  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:49 old-k8s-version-943255 kubelet[661]: E0414 11:42:49.191798     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.268402  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:52 old-k8s-version-943255 kubelet[661]: E0414 11:42:52.192457     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.268863  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:01 old-k8s-version-943255 kubelet[661]: E0414 11:43:01.191833     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.269073  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:04 old-k8s-version-943255 kubelet[661]: E0414 11:43:04.193465     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.269419  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:13 old-k8s-version-943255 kubelet[661]: E0414 11:43:13.191790     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.269619  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:19 old-k8s-version-943255 kubelet[661]: E0414 11:43:19.192065     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.269970  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:25 old-k8s-version-943255 kubelet[661]: E0414 11:43:25.191821     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.270175  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:33 old-k8s-version-943255 kubelet[661]: E0414 11:43:33.192850     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.270517  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:39 old-k8s-version-943255 kubelet[661]: E0414 11:43:39.191923     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.270717  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:48 old-k8s-version-943255 kubelet[661]: E0414 11:43:48.192882     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.271077  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:54 old-k8s-version-943255 kubelet[661]: E0414 11:43:54.192005     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.271281  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:59 old-k8s-version-943255 kubelet[661]: E0414 11:43:59.193181     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.271688  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:05 old-k8s-version-943255 kubelet[661]: E0414 11:44:05.192322     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.271908  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:11 old-k8s-version-943255 kubelet[661]: E0414 11:44:11.192365     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.272252  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:16 old-k8s-version-943255 kubelet[661]: E0414 11:44:16.192478     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.272455  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:23 old-k8s-version-943255 kubelet[661]: E0414 11:44:23.192167     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.272804  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:29 old-k8s-version-943255 kubelet[661]: E0414 11:44:29.194021     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.273004  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:37 old-k8s-version-943255 kubelet[661]: E0414 11:44:37.193029     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.273348  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:41 old-k8s-version-943255 kubelet[661]: E0414 11:44:41.192234     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	I0414 11:44:49.273379  808013 logs.go:123] Gathering logs for describe nodes ...
	I0414 11:44:49.273408  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0414 11:44:49.445671  808013 logs.go:123] Gathering logs for coredns [0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1] ...
	I0414 11:44:49.445743  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1"
	I0414 11:44:49.499885  808013 logs.go:123] Gathering logs for kube-proxy [13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1] ...
	I0414 11:44:49.499954  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1"
	I0414 11:44:49.558047  808013 logs.go:123] Gathering logs for containerd ...
	I0414 11:44:49.558124  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0414 11:44:49.621804  808013 logs.go:123] Gathering logs for container status ...
	I0414 11:44:49.621880  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0414 11:44:49.685699  808013 logs.go:123] Gathering logs for dmesg ...
	I0414 11:44:49.685873  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0414 11:44:49.708488  808013 logs.go:123] Gathering logs for kube-scheduler [1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e] ...
	I0414 11:44:49.708560  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e"
	I0414 11:44:49.761525  808013 logs.go:123] Gathering logs for kube-scheduler [f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993] ...
	I0414 11:44:49.761595  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993"
	I0414 11:44:49.816691  808013 logs.go:123] Gathering logs for storage-provisioner [e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa] ...
	I0414 11:44:49.816767  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa"
	I0414 11:44:49.871098  808013 logs.go:123] Gathering logs for etcd [22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29] ...
	I0414 11:44:49.871168  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29"
	I0414 11:44:49.957340  808013 out.go:358] Setting ErrFile to fd 2...
	I0414 11:44:49.957368  808013 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W0414 11:44:49.957436  808013 out.go:270] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0414 11:44:49.957445  808013 out.go:270]   Apr 14 11:44:16 old-k8s-version-943255 kubelet[661]: E0414 11:44:16.192478     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	  Apr 14 11:44:16 old-k8s-version-943255 kubelet[661]: E0414 11:44:16.192478     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.957453  808013 out.go:270]   Apr 14 11:44:23 old-k8s-version-943255 kubelet[661]: E0414 11:44:23.192167     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Apr 14 11:44:23 old-k8s-version-943255 kubelet[661]: E0414 11:44:23.192167     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.957460  808013 out.go:270]   Apr 14 11:44:29 old-k8s-version-943255 kubelet[661]: E0414 11:44:29.194021     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	  Apr 14 11:44:29 old-k8s-version-943255 kubelet[661]: E0414 11:44:29.194021     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.957467  808013 out.go:270]   Apr 14 11:44:37 old-k8s-version-943255 kubelet[661]: E0414 11:44:37.193029     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Apr 14 11:44:37 old-k8s-version-943255 kubelet[661]: E0414 11:44:37.193029     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.957542  808013 out.go:270]   Apr 14 11:44:41 old-k8s-version-943255 kubelet[661]: E0414 11:44:41.192234     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	  Apr 14 11:44:41 old-k8s-version-943255 kubelet[661]: E0414 11:44:41.192234     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	I0414 11:44:49.957550  808013 out.go:358] Setting ErrFile to fd 2...
	I0414 11:44:49.957557  808013 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:44:59.959458  808013 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0414 11:44:59.970865  808013 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0414 11:44:59.974990  808013 out.go:201] 
	W0414 11:44:59.978044  808013 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	W0414 11:44:59.978134  808013 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
	* Suggestion: Control Plane could not update, try minikube delete --all --purge
	W0414 11:44:59.978193  808013 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
	* Related issue: https://github.com/kubernetes/minikube/issues/11417
	W0414 11:44:59.978233  808013 out.go:270] * 
	* 
	W0414 11:44:59.979165  808013 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0414 11:44:59.983029  808013 out.go:201] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:257: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-943255 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect old-k8s-version-943255
helpers_test.go:235: (dbg) docker inspect old-k8s-version-943255:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "5339fe2ede9ae15d2cc51d4824932529455c1c44195a618ff255313a1292c8bc",
	        "Created": "2025-04-14T11:35:50.769909012Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 808139,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2025-04-14T11:38:44.051820394Z",
	            "FinishedAt": "2025-04-14T11:38:43.104548422Z"
	        },
	        "Image": "sha256:e51065ad0661308920dfd7c7ddda445e530a6bf56321f8317cb47e1df0975e7c",
	        "ResolvConfPath": "/var/lib/docker/containers/5339fe2ede9ae15d2cc51d4824932529455c1c44195a618ff255313a1292c8bc/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/5339fe2ede9ae15d2cc51d4824932529455c1c44195a618ff255313a1292c8bc/hostname",
	        "HostsPath": "/var/lib/docker/containers/5339fe2ede9ae15d2cc51d4824932529455c1c44195a618ff255313a1292c8bc/hosts",
	        "LogPath": "/var/lib/docker/containers/5339fe2ede9ae15d2cc51d4824932529455c1c44195a618ff255313a1292c8bc/5339fe2ede9ae15d2cc51d4824932529455c1c44195a618ff255313a1292c8bc-json.log",
	        "Name": "/old-k8s-version-943255",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "old-k8s-version-943255:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "old-k8s-version-943255",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "5339fe2ede9ae15d2cc51d4824932529455c1c44195a618ff255313a1292c8bc",
	                "LowerDir": "/var/lib/docker/overlay2/d20170ac530955f18fb98f9f2d159c705959339474a7cbdc1b6e3bff14edbdb2-init/diff:/var/lib/docker/overlay2/0f1eb85186734ebd8050f79437d4950f7725c43c0f3bc0c52d0850bd86f1d9d3/diff",
	                "MergedDir": "/var/lib/docker/overlay2/d20170ac530955f18fb98f9f2d159c705959339474a7cbdc1b6e3bff14edbdb2/merged",
	                "UpperDir": "/var/lib/docker/overlay2/d20170ac530955f18fb98f9f2d159c705959339474a7cbdc1b6e3bff14edbdb2/diff",
	                "WorkDir": "/var/lib/docker/overlay2/d20170ac530955f18fb98f9f2d159c705959339474a7cbdc1b6e3bff14edbdb2/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "old-k8s-version-943255",
	                "Source": "/var/lib/docker/volumes/old-k8s-version-943255/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "old-k8s-version-943255",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "old-k8s-version-943255",
	                "name.minikube.sigs.k8s.io": "old-k8s-version-943255",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "408c0d4a92713103fec936c06873e36a15e328300f148af6171337851866460d",
	            "SandboxKey": "/var/run/docker/netns/408c0d4a9271",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33806"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33807"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33810"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33808"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33809"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "old-k8s-version-943255": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.76.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "36:21:d1:9b:2f:ea",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "9211dd2fc00736d294ebebb687388176c287dab28666e1b574e151698de307b9",
	                    "EndpointID": "62855fcfe018e8ba380cb5f4134731e3a36e219661df864ea300a4451ce0bfe5",
	                    "Gateway": "192.168.76.1",
	                    "IPAddress": "192.168.76.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "old-k8s-version-943255",
	                        "5339fe2ede9a"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-943255 -n old-k8s-version-943255
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p old-k8s-version-943255 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-943255 logs -n 25: (2.587140571s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs: 
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| Command |                          Args                          |          Profile          |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| start   | -p force-systemd-flag-092734                           | force-systemd-flag-092734 | jenkins | v1.35.0 | 14 Apr 25 11:34 UTC | 14 Apr 25 11:35 UTC |
	|         | --memory=2048 --force-systemd                          |                           |         |         |                     |                     |
	|         | --alsologtostderr                                      |                           |         |         |                     |                     |
	|         | -v=5 --driver=docker                                   |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	| ssh     | force-systemd-flag-092734                              | force-systemd-flag-092734 | jenkins | v1.35.0 | 14 Apr 25 11:35 UTC | 14 Apr 25 11:35 UTC |
	|         | ssh cat                                                |                           |         |         |                     |                     |
	|         | /etc/containerd/config.toml                            |                           |         |         |                     |                     |
	| delete  | -p force-systemd-flag-092734                           | force-systemd-flag-092734 | jenkins | v1.35.0 | 14 Apr 25 11:35 UTC | 14 Apr 25 11:35 UTC |
	| start   | -p cert-options-253833                                 | cert-options-253833       | jenkins | v1.35.0 | 14 Apr 25 11:35 UTC | 14 Apr 25 11:35 UTC |
	|         | --memory=2048                                          |                           |         |         |                     |                     |
	|         | --apiserver-ips=127.0.0.1                              |                           |         |         |                     |                     |
	|         | --apiserver-ips=192.168.15.15                          |                           |         |         |                     |                     |
	|         | --apiserver-names=localhost                            |                           |         |         |                     |                     |
	|         | --apiserver-names=www.google.com                       |                           |         |         |                     |                     |
	|         | --apiserver-port=8555                                  |                           |         |         |                     |                     |
	|         | --driver=docker                                        |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	| ssh     | cert-options-253833 ssh                                | cert-options-253833       | jenkins | v1.35.0 | 14 Apr 25 11:35 UTC | 14 Apr 25 11:35 UTC |
	|         | openssl x509 -text -noout -in                          |                           |         |         |                     |                     |
	|         | /var/lib/minikube/certs/apiserver.crt                  |                           |         |         |                     |                     |
	| ssh     | -p cert-options-253833 -- sudo                         | cert-options-253833       | jenkins | v1.35.0 | 14 Apr 25 11:35 UTC | 14 Apr 25 11:35 UTC |
	|         | cat /etc/kubernetes/admin.conf                         |                           |         |         |                     |                     |
	| delete  | -p cert-options-253833                                 | cert-options-253833       | jenkins | v1.35.0 | 14 Apr 25 11:35 UTC | 14 Apr 25 11:35 UTC |
	| start   | -p old-k8s-version-943255                              | old-k8s-version-943255    | jenkins | v1.35.0 | 14 Apr 25 11:35 UTC | 14 Apr 25 11:38 UTC |
	|         | --memory=2200                                          |                           |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                           |         |         |                     |                     |
	|         | --kvm-network=default                                  |                           |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                          |                           |         |         |                     |                     |
	|         | --disable-driver-mounts                                |                           |         |         |                     |                     |
	|         | --keep-context=false                                   |                           |         |         |                     |                     |
	|         | --driver=docker                                        |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                           |                           |         |         |                     |                     |
	| start   | -p cert-expiration-541494                              | cert-expiration-541494    | jenkins | v1.35.0 | 14 Apr 25 11:38 UTC | 14 Apr 25 11:38 UTC |
	|         | --memory=2048                                          |                           |         |         |                     |                     |
	|         | --cert-expiration=8760h                                |                           |         |         |                     |                     |
	|         | --driver=docker                                        |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	| delete  | -p cert-expiration-541494                              | cert-expiration-541494    | jenkins | v1.35.0 | 14 Apr 25 11:38 UTC | 14 Apr 25 11:38 UTC |
	| start   | -p no-preload-391843                                   | no-preload-391843         | jenkins | v1.35.0 | 14 Apr 25 11:38 UTC | 14 Apr 25 11:39 UTC |
	|         | --memory=2200                                          |                           |         |         |                     |                     |
	|         | --alsologtostderr                                      |                           |         |         |                     |                     |
	|         | --wait=true --preload=false                            |                           |         |         |                     |                     |
	|         | --driver=docker                                        |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.32.2                           |                           |         |         |                     |                     |
	| addons  | enable metrics-server -p old-k8s-version-943255        | old-k8s-version-943255    | jenkins | v1.35.0 | 14 Apr 25 11:38 UTC | 14 Apr 25 11:38 UTC |
	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                           |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                 |                           |         |         |                     |                     |
	| stop    | -p old-k8s-version-943255                              | old-k8s-version-943255    | jenkins | v1.35.0 | 14 Apr 25 11:38 UTC | 14 Apr 25 11:38 UTC |
	|         | --alsologtostderr -v=3                                 |                           |         |         |                     |                     |
	| addons  | enable dashboard -p old-k8s-version-943255             | old-k8s-version-943255    | jenkins | v1.35.0 | 14 Apr 25 11:38 UTC | 14 Apr 25 11:38 UTC |
	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                           |         |         |                     |                     |
	| start   | -p old-k8s-version-943255                              | old-k8s-version-943255    | jenkins | v1.35.0 | 14 Apr 25 11:38 UTC |                     |
	|         | --memory=2200                                          |                           |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                           |         |         |                     |                     |
	|         | --kvm-network=default                                  |                           |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                          |                           |         |         |                     |                     |
	|         | --disable-driver-mounts                                |                           |         |         |                     |                     |
	|         | --keep-context=false                                   |                           |         |         |                     |                     |
	|         | --driver=docker                                        |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                           |                           |         |         |                     |                     |
	| addons  | enable metrics-server -p no-preload-391843             | no-preload-391843         | jenkins | v1.35.0 | 14 Apr 25 11:39 UTC | 14 Apr 25 11:39 UTC |
	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                           |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                 |                           |         |         |                     |                     |
	| stop    | -p no-preload-391843                                   | no-preload-391843         | jenkins | v1.35.0 | 14 Apr 25 11:39 UTC | 14 Apr 25 11:39 UTC |
	|         | --alsologtostderr -v=3                                 |                           |         |         |                     |                     |
	| addons  | enable dashboard -p no-preload-391843                  | no-preload-391843         | jenkins | v1.35.0 | 14 Apr 25 11:39 UTC | 14 Apr 25 11:39 UTC |
	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                           |         |         |                     |                     |
	| start   | -p no-preload-391843                                   | no-preload-391843         | jenkins | v1.35.0 | 14 Apr 25 11:39 UTC | 14 Apr 25 11:44 UTC |
	|         | --memory=2200                                          |                           |         |         |                     |                     |
	|         | --alsologtostderr                                      |                           |         |         |                     |                     |
	|         | --wait=true --preload=false                            |                           |         |         |                     |                     |
	|         | --driver=docker                                        |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.32.2                           |                           |         |         |                     |                     |
	| image   | no-preload-391843 image list                           | no-preload-391843         | jenkins | v1.35.0 | 14 Apr 25 11:44 UTC | 14 Apr 25 11:44 UTC |
	|         | --format=json                                          |                           |         |         |                     |                     |
	| pause   | -p no-preload-391843                                   | no-preload-391843         | jenkins | v1.35.0 | 14 Apr 25 11:44 UTC | 14 Apr 25 11:44 UTC |
	|         | --alsologtostderr -v=1                                 |                           |         |         |                     |                     |
	| unpause | -p no-preload-391843                                   | no-preload-391843         | jenkins | v1.35.0 | 14 Apr 25 11:44 UTC | 14 Apr 25 11:44 UTC |
	|         | --alsologtostderr -v=1                                 |                           |         |         |                     |                     |
	| delete  | -p no-preload-391843                                   | no-preload-391843         | jenkins | v1.35.0 | 14 Apr 25 11:44 UTC | 14 Apr 25 11:44 UTC |
	| delete  | -p no-preload-391843                                   | no-preload-391843         | jenkins | v1.35.0 | 14 Apr 25 11:44 UTC | 14 Apr 25 11:44 UTC |
	| start   | -p embed-certs-680698                                  | embed-certs-680698        | jenkins | v1.35.0 | 14 Apr 25 11:44 UTC |                     |
	|         | --memory=2200                                          |                           |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                           |         |         |                     |                     |
	|         | --embed-certs --driver=docker                          |                           |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.32.2                           |                           |         |         |                     |                     |
	|---------|--------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2025/04/14 11:44:32
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.24.0 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0414 11:44:32.759487  818978 out.go:345] Setting OutFile to fd 1 ...
	I0414 11:44:32.760027  818978 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:44:32.760063  818978 out.go:358] Setting ErrFile to fd 2...
	I0414 11:44:32.760084  818978 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:44:32.760430  818978 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
	I0414 11:44:32.761007  818978 out.go:352] Setting JSON to false
	I0414 11:44:32.762108  818978 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":12418,"bootTime":1744618655,"procs":220,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1081-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0414 11:44:32.762205  818978 start.go:139] virtualization:  
	I0414 11:44:32.766044  818978 out.go:177] * [embed-certs-680698] minikube v1.35.0 on Ubuntu 20.04 (arm64)
	I0414 11:44:32.769300  818978 out.go:177]   - MINIKUBE_LOCATION=20534
	I0414 11:44:32.769502  818978 notify.go:220] Checking for updates...
	I0414 11:44:32.775377  818978 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0414 11:44:32.778454  818978 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig
	I0414 11:44:32.781601  818978 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube
	I0414 11:44:32.784470  818978 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0414 11:44:32.787308  818978 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0414 11:44:32.790862  818978 config.go:182] Loaded profile config "old-k8s-version-943255": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0414 11:44:32.790982  818978 driver.go:394] Setting default libvirt URI to qemu:///system
	I0414 11:44:32.825660  818978 docker.go:123] docker version: linux-28.0.4:Docker Engine - Community
	I0414 11:44:32.825806  818978 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0414 11:44:32.892528  818978 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:36 OomKillDisable:true NGoroutines:52 SystemTime:2025-04-14 11:44:32.882705807 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1081-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0]] Warnings:<nil>}}
	I0414 11:44:32.892644  818978 docker.go:318] overlay module found
	I0414 11:44:32.899937  818978 out.go:177] * Using the docker driver based on user configuration
	I0414 11:44:32.903165  818978 start.go:297] selected driver: docker
	I0414 11:44:32.903185  818978 start.go:901] validating driver "docker" against <nil>
	I0414 11:44:32.903199  818978 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0414 11:44:32.904501  818978 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0414 11:44:32.958893  818978 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:36 OomKillDisable:true NGoroutines:52 SystemTime:2025-04-14 11:44:32.949649901 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1081-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0]] Warnings:<nil>}}
	I0414 11:44:32.959049  818978 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0414 11:44:32.959278  818978 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0414 11:44:32.962196  818978 out.go:177] * Using Docker driver with root privileges
	I0414 11:44:32.964983  818978 cni.go:84] Creating CNI manager for ""
	I0414 11:44:32.965061  818978 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0414 11:44:32.965075  818978 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0414 11:44:32.965150  818978 start.go:340] cluster config:
	{Name:embed-certs-680698 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:embed-certs-680698 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0414 11:44:32.968226  818978 out.go:177] * Starting "embed-certs-680698" primary control-plane node in "embed-certs-680698" cluster
	I0414 11:44:32.970951  818978 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0414 11:44:32.973985  818978 out.go:177] * Pulling base image v0.0.46-1744107393-20604 ...
	I0414 11:44:32.976963  818978 preload.go:131] Checking if preload exists for k8s version v1.32.2 and runtime containerd
	I0414 11:44:32.977027  818978 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20534-594855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-containerd-overlay2-arm64.tar.lz4
	I0414 11:44:32.977040  818978 cache.go:56] Caching tarball of preloaded images
	I0414 11:44:32.977059  818978 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a in local docker daemon
	I0414 11:44:32.977132  818978 preload.go:172] Found /home/jenkins/minikube-integration/20534-594855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I0414 11:44:32.977142  818978 cache.go:59] Finished verifying existence of preloaded tar for v1.32.2 on containerd
	I0414 11:44:32.977257  818978 profile.go:143] Saving config to /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/config.json ...
	I0414 11:44:32.977280  818978 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/config.json: {Name:mk7b2143d50aa59013ffbcd385327dc0533d3da0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0414 11:44:33.001992  818978 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a in local docker daemon, skipping pull
	I0414 11:44:33.002015  818978 cache.go:145] gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a exists in daemon, skipping load
	I0414 11:44:33.002034  818978 cache.go:230] Successfully downloaded all kic artifacts
	I0414 11:44:33.002065  818978 start.go:360] acquireMachinesLock for embed-certs-680698: {Name:mkd79cff932d8c3a8a4d53b32250e29160e57c30 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0414 11:44:33.002802  818978 start.go:364] duration metric: took 714.224µs to acquireMachinesLock for "embed-certs-680698"
	I0414 11:44:33.002842  818978 start.go:93] Provisioning new machine with config: &{Name:embed-certs-680698 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:embed-certs-680698 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0414 11:44:33.002932  818978 start.go:125] createHost starting for "" (driver="docker")
	I0414 11:44:29.652576  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:32.152298  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:33.007602  818978 out.go:235] * Creating docker container (CPUs=2, Memory=2200MB) ...
	I0414 11:44:33.007909  818978 start.go:159] libmachine.API.Create for "embed-certs-680698" (driver="docker")
	I0414 11:44:33.007967  818978 client.go:168] LocalClient.Create starting
	I0414 11:44:33.008054  818978 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca.pem
	I0414 11:44:33.008099  818978 main.go:141] libmachine: Decoding PEM data...
	I0414 11:44:33.008119  818978 main.go:141] libmachine: Parsing certificate...
	I0414 11:44:33.008188  818978 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20534-594855/.minikube/certs/cert.pem
	I0414 11:44:33.008214  818978 main.go:141] libmachine: Decoding PEM data...
	I0414 11:44:33.008225  818978 main.go:141] libmachine: Parsing certificate...
	I0414 11:44:33.008691  818978 cli_runner.go:164] Run: docker network inspect embed-certs-680698 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0414 11:44:33.028903  818978 cli_runner.go:211] docker network inspect embed-certs-680698 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0414 11:44:33.028994  818978 network_create.go:284] running [docker network inspect embed-certs-680698] to gather additional debugging logs...
	I0414 11:44:33.029015  818978 cli_runner.go:164] Run: docker network inspect embed-certs-680698
	W0414 11:44:33.045946  818978 cli_runner.go:211] docker network inspect embed-certs-680698 returned with exit code 1
	I0414 11:44:33.045992  818978 network_create.go:287] error running [docker network inspect embed-certs-680698]: docker network inspect embed-certs-680698: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network embed-certs-680698 not found
	I0414 11:44:33.046006  818978 network_create.go:289] output of [docker network inspect embed-certs-680698]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network embed-certs-680698 not found
	
	** /stderr **
	I0414 11:44:33.046103  818978 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0414 11:44:33.064855  818978 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-da2afc92daab IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:ee:7f:23:65:0d:d3} reservation:<nil>}
	I0414 11:44:33.065228  818978 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-0a17d43adfce IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:72:07:d3:b8:1e:c4} reservation:<nil>}
	I0414 11:44:33.065533  818978 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-f655451ccd45 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:ca:9a:13:91:db:71} reservation:<nil>}
	I0414 11:44:33.065880  818978 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-9211dd2fc007 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:6a:f1:06:a2:44:22} reservation:<nil>}
	I0414 11:44:33.066318  818978 network.go:206] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001a06fa0}
	I0414 11:44:33.066341  818978 network_create.go:124] attempt to create docker network embed-certs-680698 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
	I0414 11:44:33.066411  818978 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-680698 embed-certs-680698
	I0414 11:44:33.130253  818978 network_create.go:108] docker network embed-certs-680698 192.168.85.0/24 created
	I0414 11:44:33.130288  818978 kic.go:121] calculated static IP "192.168.85.2" for the "embed-certs-680698" container
	I0414 11:44:33.130368  818978 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0414 11:44:33.145872  818978 cli_runner.go:164] Run: docker volume create embed-certs-680698 --label name.minikube.sigs.k8s.io=embed-certs-680698 --label created_by.minikube.sigs.k8s.io=true
	I0414 11:44:33.165675  818978 oci.go:103] Successfully created a docker volume embed-certs-680698
	I0414 11:44:33.165760  818978 cli_runner.go:164] Run: docker run --rm --name embed-certs-680698-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-680698 --entrypoint /usr/bin/test -v embed-certs-680698:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a -d /var/lib
	I0414 11:44:33.736995  818978 oci.go:107] Successfully prepared a docker volume embed-certs-680698
	I0414 11:44:33.737052  818978 preload.go:131] Checking if preload exists for k8s version v1.32.2 and runtime containerd
	I0414 11:44:33.737074  818978 kic.go:194] Starting extracting preloaded images to volume ...
	I0414 11:44:33.737159  818978 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20534-594855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-680698:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a -I lz4 -xf /preloaded.tar -C /extractDir
	I0414 11:44:34.152828  808013 pod_ready.go:103] pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace has status "Ready":"False"
	I0414 11:44:35.645880  808013 pod_ready.go:82] duration metric: took 4m0.000127627s for pod "metrics-server-9975d5f86-7rqxd" in "kube-system" namespace to be "Ready" ...
	E0414 11:44:35.645914  808013 pod_ready.go:67] WaitExtra: waitPodCondition: context deadline exceeded
	I0414 11:44:35.645924  808013 pod_ready.go:39] duration metric: took 5m25.733004506s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0414 11:44:35.645943  808013 api_server.go:52] waiting for apiserver process to appear ...
	I0414 11:44:35.645987  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0414 11:44:35.646052  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0414 11:44:35.707213  808013 cri.go:89] found id: "e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8"
	I0414 11:44:35.707232  808013 cri.go:89] found id: "461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42"
	I0414 11:44:35.707238  808013 cri.go:89] found id: ""
	I0414 11:44:35.707246  808013 logs.go:282] 2 containers: [e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8 461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42]
	I0414 11:44:35.707300  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.711354  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.714967  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0414 11:44:35.715030  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0414 11:44:35.764599  808013 cri.go:89] found id: "22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29"
	I0414 11:44:35.764619  808013 cri.go:89] found id: "dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c"
	I0414 11:44:35.764624  808013 cri.go:89] found id: ""
	I0414 11:44:35.764631  808013 logs.go:282] 2 containers: [22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29 dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c]
	I0414 11:44:35.764691  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.769219  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.773412  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0414 11:44:35.773552  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0414 11:44:35.822306  808013 cri.go:89] found id: "0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1"
	I0414 11:44:35.822385  808013 cri.go:89] found id: "33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507"
	I0414 11:44:35.822405  808013 cri.go:89] found id: ""
	I0414 11:44:35.822429  808013 logs.go:282] 2 containers: [0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1 33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507]
	I0414 11:44:35.822547  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.830286  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.835154  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0414 11:44:35.835274  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0414 11:44:35.918515  808013 cri.go:89] found id: "1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e"
	I0414 11:44:35.918538  808013 cri.go:89] found id: "f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993"
	I0414 11:44:35.918543  808013 cri.go:89] found id: ""
	I0414 11:44:35.918550  808013 logs.go:282] 2 containers: [1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993]
	I0414 11:44:35.918605  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.922874  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.926497  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0414 11:44:35.926568  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0414 11:44:35.968096  808013 cri.go:89] found id: "79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803"
	I0414 11:44:35.968115  808013 cri.go:89] found id: "13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1"
	I0414 11:44:35.968121  808013 cri.go:89] found id: ""
	I0414 11:44:35.968129  808013 logs.go:282] 2 containers: [79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803 13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1]
	I0414 11:44:35.968182  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.972186  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:35.976008  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0414 11:44:35.976077  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0414 11:44:36.027663  808013 cri.go:89] found id: "2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6"
	I0414 11:44:36.027688  808013 cri.go:89] found id: "d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6"
	I0414 11:44:36.027695  808013 cri.go:89] found id: ""
	I0414 11:44:36.027702  808013 logs.go:282] 2 containers: [2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6 d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6]
	I0414 11:44:36.027763  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:36.032426  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:36.036295  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I0414 11:44:36.036366  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0414 11:44:36.118257  808013 cri.go:89] found id: "54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d"
	I0414 11:44:36.118281  808013 cri.go:89] found id: "e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265"
	I0414 11:44:36.118286  808013 cri.go:89] found id: ""
	I0414 11:44:36.118293  808013 logs.go:282] 2 containers: [54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265]
	I0414 11:44:36.118353  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:36.122642  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:36.127259  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0414 11:44:36.127347  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0414 11:44:36.174126  808013 cri.go:89] found id: "e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa"
	I0414 11:44:36.174145  808013 cri.go:89] found id: "daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9"
	I0414 11:44:36.174150  808013 cri.go:89] found id: ""
	I0414 11:44:36.174158  808013 logs.go:282] 2 containers: [e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9]
	I0414 11:44:36.174218  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:36.178084  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:36.181804  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0414 11:44:36.181872  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0414 11:44:36.251384  808013 cri.go:89] found id: "59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566"
	I0414 11:44:36.251408  808013 cri.go:89] found id: ""
	I0414 11:44:36.251416  808013 logs.go:282] 1 containers: [59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566]
	I0414 11:44:36.251473  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:36.255371  808013 logs.go:123] Gathering logs for dmesg ...
	I0414 11:44:36.255396  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0414 11:44:36.272452  808013 logs.go:123] Gathering logs for etcd [dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c] ...
	I0414 11:44:36.272478  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c"
	I0414 11:44:36.330279  808013 logs.go:123] Gathering logs for kube-scheduler [1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e] ...
	I0414 11:44:36.330308  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e"
	I0414 11:44:36.383084  808013 logs.go:123] Gathering logs for kube-proxy [79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803] ...
	I0414 11:44:36.383113  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803"
	I0414 11:44:36.442830  808013 logs.go:123] Gathering logs for storage-provisioner [e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa] ...
	I0414 11:44:36.442858  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa"
	I0414 11:44:36.495051  808013 logs.go:123] Gathering logs for container status ...
	I0414 11:44:36.495079  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0414 11:44:36.544394  808013 logs.go:123] Gathering logs for describe nodes ...
	I0414 11:44:36.544425  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0414 11:44:36.779585  808013 logs.go:123] Gathering logs for coredns [0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1] ...
	I0414 11:44:36.779619  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1"
	I0414 11:44:36.826566  808013 logs.go:123] Gathering logs for kube-controller-manager [2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6] ...
	I0414 11:44:36.826591  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6"
	I0414 11:44:36.900218  808013 logs.go:123] Gathering logs for storage-provisioner [daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9] ...
	I0414 11:44:36.900315  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9"
	I0414 11:44:36.958930  808013 logs.go:123] Gathering logs for kube-apiserver [e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8] ...
	I0414 11:44:36.958961  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8"
	I0414 11:44:37.042579  808013 logs.go:123] Gathering logs for etcd [22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29] ...
	I0414 11:44:37.042697  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29"
	I0414 11:44:37.116857  808013 logs.go:123] Gathering logs for kube-proxy [13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1] ...
	I0414 11:44:37.117086  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1"
	I0414 11:44:37.179108  808013 logs.go:123] Gathering logs for kube-controller-manager [d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6] ...
	I0414 11:44:37.179189  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6"
	I0414 11:44:37.253469  808013 logs.go:123] Gathering logs for kindnet [e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265] ...
	I0414 11:44:37.253548  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265"
	I0414 11:44:37.324129  808013 logs.go:123] Gathering logs for containerd ...
	I0414 11:44:37.324153  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0414 11:44:37.396825  808013 logs.go:123] Gathering logs for kubelet ...
	I0414 11:44:37.396907  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0414 11:44:37.459287  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.671664     661 reflector.go:138] object-"kube-system"/"kube-proxy-token-f29ww": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-f29ww" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.459575  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.678711     661 reflector.go:138] object-"kube-system"/"kindnet-token-srz8d": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-srz8d" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.459824  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.679945     661 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.460067  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.681204     661 reflector.go:138] object-"kube-system"/"coredns-token-lkmz8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-lkmz8" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.460320  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.681667     661 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.460557  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.689142     661 reflector.go:138] object-"default"/"default-token-6r6dc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-6r6dc" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.464420  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.710198     661 reflector.go:138] object-"kube-system"/"storage-provisioner-token-cbmxs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-cbmxs" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.464698  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.823295     661 reflector.go:138] object-"kube-system"/"metrics-server-token-9hmzl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-9hmzl" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:37.472775  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:12 old-k8s-version-943255 kubelet[661]: E0414 11:39:12.493034     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:37.473017  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:12 old-k8s-version-943255 kubelet[661]: E0414 11:39:12.517194     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.475829  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:27 old-k8s-version-943255 kubelet[661]: E0414 11:39:27.201995     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:37.478046  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:34 old-k8s-version-943255 kubelet[661]: E0414 11:39:34.614078     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.478423  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:35 old-k8s-version-943255 kubelet[661]: E0414 11:39:35.636481     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.478777  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:36 old-k8s-version-943255 kubelet[661]: E0414 11:39:36.642188     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.478985  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:39 old-k8s-version-943255 kubelet[661]: E0414 11:39:39.192063     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.479803  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:42 old-k8s-version-943255 kubelet[661]: E0414 11:39:42.656633     661 pod_workers.go:191] Error syncing pod 70b78d06-fcec-4cd3-9143-9c2bd9176c52 ("storage-provisioner_kube-system(70b78d06-fcec-4cd3-9143-9c2bd9176c52)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(70b78d06-fcec-4cd3-9143-9c2bd9176c52)"
	W0414 11:44:37.480421  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:47 old-k8s-version-943255 kubelet[661]: E0414 11:39:47.688060     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.485301  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:54 old-k8s-version-943255 kubelet[661]: E0414 11:39:54.213195     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:37.485704  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:55 old-k8s-version-943255 kubelet[661]: E0414 11:39:55.053328     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.486062  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:09 old-k8s-version-943255 kubelet[661]: E0414 11:40:09.192116     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.486679  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:10 old-k8s-version-943255 kubelet[661]: E0414 11:40:10.769424     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.487042  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:15 old-k8s-version-943255 kubelet[661]: E0414 11:40:15.053424     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.487261  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:24 old-k8s-version-943255 kubelet[661]: E0414 11:40:24.192449     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.487611  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:27 old-k8s-version-943255 kubelet[661]: E0414 11:40:27.191843     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.490088  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:38 old-k8s-version-943255 kubelet[661]: E0414 11:40:38.205282     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:37.490441  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:39 old-k8s-version-943255 kubelet[661]: E0414 11:40:39.191989     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.490650  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:49 old-k8s-version-943255 kubelet[661]: E0414 11:40:49.192230     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.491273  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:53 old-k8s-version-943255 kubelet[661]: E0414 11:40:53.882336     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.491633  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:55 old-k8s-version-943255 kubelet[661]: E0414 11:40:55.053117     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.491842  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:02 old-k8s-version-943255 kubelet[661]: E0414 11:41:02.195946     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.492237  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:06 old-k8s-version-943255 kubelet[661]: E0414 11:41:06.191978     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.492502  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:13 old-k8s-version-943255 kubelet[661]: E0414 11:41:13.192235     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.492862  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:21 old-k8s-version-943255 kubelet[661]: E0414 11:41:21.191820     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.493305  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:25 old-k8s-version-943255 kubelet[661]: E0414 11:41:25.192141     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.493673  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:34 old-k8s-version-943255 kubelet[661]: E0414 11:41:34.191786     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.493892  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:39 old-k8s-version-943255 kubelet[661]: E0414 11:41:39.192207     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.494265  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:47 old-k8s-version-943255 kubelet[661]: E0414 11:41:47.191837     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.494510  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:52 old-k8s-version-943255 kubelet[661]: E0414 11:41:52.194045     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.494865  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:00 old-k8s-version-943255 kubelet[661]: E0414 11:42:00.196599     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.497330  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:04 old-k8s-version-943255 kubelet[661]: E0414 11:42:04.200603     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:37.497985  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:16 old-k8s-version-943255 kubelet[661]: E0414 11:42:16.072747     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.498194  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:18 old-k8s-version-943255 kubelet[661]: E0414 11:42:18.200708     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.498551  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:25 old-k8s-version-943255 kubelet[661]: E0414 11:42:25.053597     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.498765  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:30 old-k8s-version-943255 kubelet[661]: E0414 11:42:30.192906     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.499164  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:37 old-k8s-version-943255 kubelet[661]: E0414 11:42:37.192466     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.499401  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:41 old-k8s-version-943255 kubelet[661]: E0414 11:42:41.192467     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.499793  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:49 old-k8s-version-943255 kubelet[661]: E0414 11:42:49.191798     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.500002  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:52 old-k8s-version-943255 kubelet[661]: E0414 11:42:52.192457     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.500398  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:01 old-k8s-version-943255 kubelet[661]: E0414 11:43:01.191833     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.500634  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:04 old-k8s-version-943255 kubelet[661]: E0414 11:43:04.193465     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.500989  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:13 old-k8s-version-943255 kubelet[661]: E0414 11:43:13.191790     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.501207  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:19 old-k8s-version-943255 kubelet[661]: E0414 11:43:19.192065     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.501566  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:25 old-k8s-version-943255 kubelet[661]: E0414 11:43:25.191821     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.501786  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:33 old-k8s-version-943255 kubelet[661]: E0414 11:43:33.192850     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.502138  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:39 old-k8s-version-943255 kubelet[661]: E0414 11:43:39.191923     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.502347  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:48 old-k8s-version-943255 kubelet[661]: E0414 11:43:48.192882     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.502694  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:54 old-k8s-version-943255 kubelet[661]: E0414 11:43:54.192005     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.502902  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:59 old-k8s-version-943255 kubelet[661]: E0414 11:43:59.193181     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.503257  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:05 old-k8s-version-943255 kubelet[661]: E0414 11:44:05.192322     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.503464  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:11 old-k8s-version-943255 kubelet[661]: E0414 11:44:11.192365     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.503864  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:16 old-k8s-version-943255 kubelet[661]: E0414 11:44:16.192478     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.504075  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:23 old-k8s-version-943255 kubelet[661]: E0414 11:44:23.192167     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.504438  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:29 old-k8s-version-943255 kubelet[661]: E0414 11:44:29.194021     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.504652  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:37 old-k8s-version-943255 kubelet[661]: E0414 11:44:37.193029     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I0414 11:44:37.504678  808013 logs.go:123] Gathering logs for kube-apiserver [461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42] ...
	I0414 11:44:37.504708  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42"
	I0414 11:44:37.571239  808013 logs.go:123] Gathering logs for coredns [33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507] ...
	I0414 11:44:37.571325  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507"
	I0414 11:44:37.625288  808013 logs.go:123] Gathering logs for kube-scheduler [f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993] ...
	I0414 11:44:37.625358  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993"
	I0414 11:44:37.681927  808013 logs.go:123] Gathering logs for kindnet [54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d] ...
	I0414 11:44:37.681964  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d"
	I0414 11:44:37.744768  808013 logs.go:123] Gathering logs for kubernetes-dashboard [59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566] ...
	I0414 11:44:37.744804  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566"
	I0414 11:44:37.801721  808013 out.go:358] Setting ErrFile to fd 2...
	I0414 11:44:37.801748  808013 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W0414 11:44:37.801858  808013 out.go:270] X Problems detected in kubelet:
	W0414 11:44:37.801875  808013 out.go:270]   Apr 14 11:44:11 old-k8s-version-943255 kubelet[661]: E0414 11:44:11.192365     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.801882  808013 out.go:270]   Apr 14 11:44:16 old-k8s-version-943255 kubelet[661]: E0414 11:44:16.192478     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.801891  808013 out.go:270]   Apr 14 11:44:23 old-k8s-version-943255 kubelet[661]: E0414 11:44:23.192167     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:37.802008  808013 out.go:270]   Apr 14 11:44:29 old-k8s-version-943255 kubelet[661]: E0414 11:44:29.194021     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:37.802018  808013 out.go:270]   Apr 14 11:44:37 old-k8s-version-943255 kubelet[661]: E0414 11:44:37.193029     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	I0414 11:44:37.802024  808013 out.go:358] Setting ErrFile to fd 2...
	I0414 11:44:37.802031  808013 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:44:39.259258  818978 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20534-594855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-680698:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a -I lz4 -xf /preloaded.tar -C /extractDir: (5.522058698s)
	I0414 11:44:39.259290  818978 kic.go:203] duration metric: took 5.522212201s to extract preloaded images to volume ...
	W0414 11:44:39.259441  818978 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0414 11:44:39.259558  818978 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0414 11:44:39.326659  818978 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-680698 --name embed-certs-680698 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-680698 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-680698 --network embed-certs-680698 --ip 192.168.85.2 --volume embed-certs-680698:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a
	I0414 11:44:39.660275  818978 cli_runner.go:164] Run: docker container inspect embed-certs-680698 --format={{.State.Running}}
	I0414 11:44:39.683766  818978 cli_runner.go:164] Run: docker container inspect embed-certs-680698 --format={{.State.Status}}
	I0414 11:44:39.710046  818978 cli_runner.go:164] Run: docker exec embed-certs-680698 stat /var/lib/dpkg/alternatives/iptables
	I0414 11:44:39.771940  818978 oci.go:144] the created container "embed-certs-680698" has a running status.
	I0414 11:44:39.771974  818978 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20534-594855/.minikube/machines/embed-certs-680698/id_rsa...
	I0414 11:44:40.307638  818978 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20534-594855/.minikube/machines/embed-certs-680698/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0414 11:44:40.336342  818978 cli_runner.go:164] Run: docker container inspect embed-certs-680698 --format={{.State.Status}}
	I0414 11:44:40.360074  818978 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0414 11:44:40.360104  818978 kic_runner.go:114] Args: [docker exec --privileged embed-certs-680698 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0414 11:44:40.420643  818978 cli_runner.go:164] Run: docker container inspect embed-certs-680698 --format={{.State.Status}}
	I0414 11:44:40.451520  818978 machine.go:93] provisionDockerMachine start ...
	I0414 11:44:40.451626  818978 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-680698
	I0414 11:44:40.471912  818978 main.go:141] libmachine: Using SSH client type: native
	I0414 11:44:40.472248  818978 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e66c0] 0x3e8e80 <nil>  [] 0s} 127.0.0.1 33816 <nil> <nil>}
	I0414 11:44:40.472264  818978 main.go:141] libmachine: About to run SSH command:
	hostname
	I0414 11:44:40.641813  818978 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-680698
	
	I0414 11:44:40.641839  818978 ubuntu.go:169] provisioning hostname "embed-certs-680698"
	I0414 11:44:40.641907  818978 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-680698
	I0414 11:44:40.665352  818978 main.go:141] libmachine: Using SSH client type: native
	I0414 11:44:40.665675  818978 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e66c0] 0x3e8e80 <nil>  [] 0s} 127.0.0.1 33816 <nil> <nil>}
	I0414 11:44:40.665693  818978 main.go:141] libmachine: About to run SSH command:
	sudo hostname embed-certs-680698 && echo "embed-certs-680698" | sudo tee /etc/hostname
	I0414 11:44:40.811312  818978 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-680698
	
	I0414 11:44:40.811463  818978 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-680698
	I0414 11:44:40.833711  818978 main.go:141] libmachine: Using SSH client type: native
	I0414 11:44:40.834059  818978 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e66c0] 0x3e8e80 <nil>  [] 0s} 127.0.0.1 33816 <nil> <nil>}
	I0414 11:44:40.834078  818978 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-680698' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-680698/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-680698' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0414 11:44:40.961870  818978 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0414 11:44:40.961892  818978 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/20534-594855/.minikube CaCertPath:/home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20534-594855/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20534-594855/.minikube}
	I0414 11:44:40.961927  818978 ubuntu.go:177] setting up certificates
	I0414 11:44:40.961938  818978 provision.go:84] configureAuth start
	I0414 11:44:40.962001  818978 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-680698
	I0414 11:44:40.984285  818978 provision.go:143] copyHostCerts
	I0414 11:44:40.984357  818978 exec_runner.go:144] found /home/jenkins/minikube-integration/20534-594855/.minikube/ca.pem, removing ...
	I0414 11:44:40.984366  818978 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20534-594855/.minikube/ca.pem
	I0414 11:44:40.984455  818978 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20534-594855/.minikube/ca.pem (1082 bytes)
	I0414 11:44:40.984556  818978 exec_runner.go:144] found /home/jenkins/minikube-integration/20534-594855/.minikube/cert.pem, removing ...
	I0414 11:44:40.984561  818978 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20534-594855/.minikube/cert.pem
	I0414 11:44:40.984588  818978 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20534-594855/.minikube/cert.pem (1123 bytes)
	I0414 11:44:40.984652  818978 exec_runner.go:144] found /home/jenkins/minikube-integration/20534-594855/.minikube/key.pem, removing ...
	I0414 11:44:40.984657  818978 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20534-594855/.minikube/key.pem
	I0414 11:44:40.984680  818978 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20534-594855/.minikube/key.pem (1675 bytes)
	I0414 11:44:40.984733  818978 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20534-594855/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca-key.pem org=jenkins.embed-certs-680698 san=[127.0.0.1 192.168.85.2 embed-certs-680698 localhost minikube]
	I0414 11:44:41.414650  818978 provision.go:177] copyRemoteCerts
	I0414 11:44:41.414728  818978 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0414 11:44:41.414776  818978 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-680698
	I0414 11:44:41.433313  818978 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33816 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/embed-certs-680698/id_rsa Username:docker}
	I0414 11:44:41.526904  818978 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
	I0414 11:44:41.552811  818978 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0414 11:44:41.579049  818978 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0414 11:44:41.605661  818978 provision.go:87] duration metric: took 643.709448ms to configureAuth
	I0414 11:44:41.605688  818978 ubuntu.go:193] setting minikube options for container-runtime
	I0414 11:44:41.605921  818978 config.go:182] Loaded profile config "embed-certs-680698": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
	I0414 11:44:41.605930  818978 machine.go:96] duration metric: took 1.154392417s to provisionDockerMachine
	I0414 11:44:41.605937  818978 client.go:171] duration metric: took 8.597960822s to LocalClient.Create
	I0414 11:44:41.605959  818978 start.go:167] duration metric: took 8.598053664s to libmachine.API.Create "embed-certs-680698"
	I0414 11:44:41.605967  818978 start.go:293] postStartSetup for "embed-certs-680698" (driver="docker")
	I0414 11:44:41.605976  818978 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0414 11:44:41.606027  818978 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0414 11:44:41.606070  818978 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-680698
	I0414 11:44:41.623232  818978 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33816 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/embed-certs-680698/id_rsa Username:docker}
	I0414 11:44:41.719844  818978 ssh_runner.go:195] Run: cat /etc/os-release
	I0414 11:44:41.723815  818978 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0414 11:44:41.723859  818978 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0414 11:44:41.723871  818978 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0414 11:44:41.723879  818978 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0414 11:44:41.723895  818978 filesync.go:126] Scanning /home/jenkins/minikube-integration/20534-594855/.minikube/addons for local assets ...
	I0414 11:44:41.723952  818978 filesync.go:126] Scanning /home/jenkins/minikube-integration/20534-594855/.minikube/files for local assets ...
	I0414 11:44:41.724035  818978 filesync.go:149] local asset: /home/jenkins/minikube-integration/20534-594855/.minikube/files/etc/ssl/certs/6002272.pem -> 6002272.pem in /etc/ssl/certs
	I0414 11:44:41.724140  818978 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0414 11:44:41.733341  818978 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/files/etc/ssl/certs/6002272.pem --> /etc/ssl/certs/6002272.pem (1708 bytes)
	I0414 11:44:41.759561  818978 start.go:296] duration metric: took 153.580322ms for postStartSetup
	I0414 11:44:41.760149  818978 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-680698
	I0414 11:44:41.778385  818978 profile.go:143] Saving config to /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/config.json ...
	I0414 11:44:41.778675  818978 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0414 11:44:41.778727  818978 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-680698
	I0414 11:44:41.797315  818978 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33816 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/embed-certs-680698/id_rsa Username:docker}
	I0414 11:44:41.887709  818978 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0414 11:44:41.893076  818978 start.go:128] duration metric: took 8.890127902s to createHost
	I0414 11:44:41.893103  818978 start.go:83] releasing machines lock for "embed-certs-680698", held for 8.890284302s
	I0414 11:44:41.893194  818978 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-680698
	I0414 11:44:41.917218  818978 ssh_runner.go:195] Run: cat /version.json
	I0414 11:44:41.917263  818978 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0414 11:44:41.917287  818978 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-680698
	I0414 11:44:41.917333  818978 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-680698
	I0414 11:44:41.937139  818978 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33816 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/embed-certs-680698/id_rsa Username:docker}
	I0414 11:44:41.945912  818978 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33816 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/embed-certs-680698/id_rsa Username:docker}
	I0414 11:44:42.032227  818978 ssh_runner.go:195] Run: systemctl --version
	I0414 11:44:42.174861  818978 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0414 11:44:42.181817  818978 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0414 11:44:42.226194  818978 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0414 11:44:42.226371  818978 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0414 11:44:42.272783  818978 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0414 11:44:42.272822  818978 start.go:495] detecting cgroup driver to use...
	I0414 11:44:42.272872  818978 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0414 11:44:42.272944  818978 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0414 11:44:42.291428  818978 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0414 11:44:42.306873  818978 docker.go:217] disabling cri-docker service (if available) ...
	I0414 11:44:42.307011  818978 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0414 11:44:42.327133  818978 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0414 11:44:42.346862  818978 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0414 11:44:42.484525  818978 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0414 11:44:42.584776  818978 docker.go:233] disabling docker service ...
	I0414 11:44:42.584856  818978 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0414 11:44:42.610005  818978 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0414 11:44:42.623965  818978 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0414 11:44:42.750469  818978 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0414 11:44:42.834809  818978 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0414 11:44:42.846562  818978 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0414 11:44:42.862569  818978 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
	I0414 11:44:42.873110  818978 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0414 11:44:42.883366  818978 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I0414 11:44:42.883490  818978 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0414 11:44:42.894143  818978 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0414 11:44:42.907245  818978 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0414 11:44:42.916757  818978 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0414 11:44:42.926379  818978 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0414 11:44:42.935798  818978 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0414 11:44:42.946366  818978 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
	I0414 11:44:42.956913  818978 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"
	I0414 11:44:42.967406  818978 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0414 11:44:42.976097  818978 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0414 11:44:42.984804  818978 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0414 11:44:43.074951  818978 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0414 11:44:43.201816  818978 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
	I0414 11:44:43.201930  818978 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0414 11:44:43.206172  818978 start.go:563] Will wait 60s for crictl version
	I0414 11:44:43.206263  818978 ssh_runner.go:195] Run: which crictl
	I0414 11:44:43.209895  818978 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0414 11:44:43.251861  818978 start.go:579] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.7.27
	RuntimeApiVersion:  v1
	I0414 11:44:43.251985  818978 ssh_runner.go:195] Run: containerd --version
	I0414 11:44:43.276304  818978 ssh_runner.go:195] Run: containerd --version
	I0414 11:44:43.302635  818978 out.go:177] * Preparing Kubernetes v1.32.2 on containerd 1.7.27 ...
	I0414 11:44:43.305577  818978 cli_runner.go:164] Run: docker network inspect embed-certs-680698 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0414 11:44:43.320281  818978 ssh_runner.go:195] Run: grep 192.168.85.1	host.minikube.internal$ /etc/hosts
	I0414 11:44:43.324075  818978 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0414 11:44:43.336172  818978 kubeadm.go:883] updating cluster {Name:embed-certs-680698 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:embed-certs-680698 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0414 11:44:43.336284  818978 preload.go:131] Checking if preload exists for k8s version v1.32.2 and runtime containerd
	I0414 11:44:43.336344  818978 ssh_runner.go:195] Run: sudo crictl images --output json
	I0414 11:44:43.377204  818978 containerd.go:627] all images are preloaded for containerd runtime.
	I0414 11:44:43.377228  818978 containerd.go:534] Images already preloaded, skipping extraction
	I0414 11:44:43.377287  818978 ssh_runner.go:195] Run: sudo crictl images --output json
	I0414 11:44:43.415320  818978 containerd.go:627] all images are preloaded for containerd runtime.
	I0414 11:44:43.415344  818978 cache_images.go:84] Images are preloaded, skipping loading
	I0414 11:44:43.415352  818978 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.32.2 containerd true true} ...
	I0414 11:44:43.415442  818978 kubeadm.go:946] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.32.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-680698 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.32.2 ClusterName:embed-certs-680698 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0414 11:44:43.415511  818978 ssh_runner.go:195] Run: sudo crictl info
	I0414 11:44:43.453952  818978 cni.go:84] Creating CNI manager for ""
	I0414 11:44:43.453983  818978 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0414 11:44:43.453994  818978 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0414 11:44:43.454018  818978 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.32.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-680698 NodeName:embed-certs-680698 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0414 11:44:43.454130  818978 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.85.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///run/containerd/containerd.sock
	  name: "embed-certs-680698"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.85.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      - name: "proxy-refresh-interval"
	        value: "70000"
	kubernetesVersion: v1.32.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0414 11:44:43.454205  818978 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.32.2
	I0414 11:44:43.465329  818978 binaries.go:44] Found k8s binaries, skipping transfer
	I0414 11:44:43.465407  818978 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0414 11:44:43.475174  818978 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
	I0414 11:44:43.494223  818978 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0414 11:44:43.515412  818978 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2308 bytes)
	I0414 11:44:43.534497  818978 ssh_runner.go:195] Run: grep 192.168.85.2	control-plane.minikube.internal$ /etc/hosts
	I0414 11:44:43.538027  818978 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0414 11:44:43.549039  818978 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0414 11:44:43.630345  818978 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0414 11:44:43.644307  818978 certs.go:68] Setting up /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698 for IP: 192.168.85.2
	I0414 11:44:43.644329  818978 certs.go:194] generating shared ca certs ...
	I0414 11:44:43.644345  818978 certs.go:226] acquiring lock for ca certs: {Name:mkc72929fdde159a4ce614d0ceb68f60716f5790 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0414 11:44:43.644522  818978 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20534-594855/.minikube/ca.key
	I0414 11:44:43.644572  818978 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20534-594855/.minikube/proxy-client-ca.key
	I0414 11:44:43.644585  818978 certs.go:256] generating profile certs ...
	I0414 11:44:43.644644  818978 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/client.key
	I0414 11:44:43.644668  818978 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/client.crt with IP's: []
	I0414 11:44:44.085659  818978 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/client.crt ...
	I0414 11:44:44.085698  818978 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/client.crt: {Name:mk780a03bc4b13067f4b7fd783759097f13cce89 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0414 11:44:44.086014  818978 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/client.key ...
	I0414 11:44:44.086030  818978 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/client.key: {Name:mkd4dc780a4531b0defac099246457024829c1d0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0414 11:44:44.086569  818978 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/apiserver.key.2ff3eea1
	I0414 11:44:44.086595  818978 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/apiserver.crt.2ff3eea1 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.85.2]
	I0414 11:44:44.613082  818978 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/apiserver.crt.2ff3eea1 ...
	I0414 11:44:44.613113  818978 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/apiserver.crt.2ff3eea1: {Name:mkdc82dc204c11c100efba10e89ee6ac2334d894 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0414 11:44:44.613839  818978 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/apiserver.key.2ff3eea1 ...
	I0414 11:44:44.613859  818978 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/apiserver.key.2ff3eea1: {Name:mkb3688f6bca7d6bc659962ff71b551056aec078 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0414 11:44:44.613965  818978 certs.go:381] copying /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/apiserver.crt.2ff3eea1 -> /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/apiserver.crt
	I0414 11:44:44.614044  818978 certs.go:385] copying /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/apiserver.key.2ff3eea1 -> /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/apiserver.key
	I0414 11:44:44.614105  818978 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/proxy-client.key
	I0414 11:44:44.614126  818978 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/proxy-client.crt with IP's: []
	I0414 11:44:44.685487  818978 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/proxy-client.crt ...
	I0414 11:44:44.685513  818978 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/proxy-client.crt: {Name:mkf6a3925425c275652f2c9e6ab88e2c03c24a40 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0414 11:44:44.685701  818978 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/proxy-client.key ...
	I0414 11:44:44.685715  818978 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/proxy-client.key: {Name:mkfae83547d15261b767924b7bbc5e806083033f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0414 11:44:44.686402  818978 certs.go:484] found cert: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/600227.pem (1338 bytes)
	W0414 11:44:44.686465  818978 certs.go:480] ignoring /home/jenkins/minikube-integration/20534-594855/.minikube/certs/600227_empty.pem, impossibly tiny 0 bytes
	I0414 11:44:44.686484  818978 certs.go:484] found cert: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca-key.pem (1675 bytes)
	I0414 11:44:44.686513  818978 certs.go:484] found cert: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/ca.pem (1082 bytes)
	I0414 11:44:44.686570  818978 certs.go:484] found cert: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/cert.pem (1123 bytes)
	I0414 11:44:44.686621  818978 certs.go:484] found cert: /home/jenkins/minikube-integration/20534-594855/.minikube/certs/key.pem (1675 bytes)
	I0414 11:44:44.686686  818978 certs.go:484] found cert: /home/jenkins/minikube-integration/20534-594855/.minikube/files/etc/ssl/certs/6002272.pem (1708 bytes)
	I0414 11:44:44.687241  818978 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0414 11:44:44.719421  818978 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0414 11:44:44.746063  818978 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0414 11:44:44.771766  818978 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0414 11:44:44.797037  818978 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
	I0414 11:44:44.822904  818978 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0414 11:44:44.848505  818978 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0414 11:44:44.872768  818978 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/embed-certs-680698/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0414 11:44:44.902092  818978 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/certs/600227.pem --> /usr/share/ca-certificates/600227.pem (1338 bytes)
	I0414 11:44:44.928404  818978 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/files/etc/ssl/certs/6002272.pem --> /usr/share/ca-certificates/6002272.pem (1708 bytes)
	I0414 11:44:44.954108  818978 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20534-594855/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0414 11:44:44.980797  818978 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0414 11:44:44.999501  818978 ssh_runner.go:195] Run: openssl version
	I0414 11:44:45.021116  818978 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/600227.pem && ln -fs /usr/share/ca-certificates/600227.pem /etc/ssl/certs/600227.pem"
	I0414 11:44:45.058179  818978 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/600227.pem
	I0414 11:44:45.063523  818978 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 14 11:01 /usr/share/ca-certificates/600227.pem
	I0414 11:44:45.063597  818978 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/600227.pem
	I0414 11:44:45.073793  818978 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/600227.pem /etc/ssl/certs/51391683.0"
	I0414 11:44:45.086974  818978 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6002272.pem && ln -fs /usr/share/ca-certificates/6002272.pem /etc/ssl/certs/6002272.pem"
	I0414 11:44:45.102566  818978 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6002272.pem
	I0414 11:44:45.108096  818978 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 14 11:01 /usr/share/ca-certificates/6002272.pem
	I0414 11:44:45.108175  818978 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6002272.pem
	I0414 11:44:45.118283  818978 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/6002272.pem /etc/ssl/certs/3ec20f2e.0"
	I0414 11:44:45.131214  818978 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0414 11:44:45.147905  818978 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0414 11:44:45.153888  818978 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 14 10:53 /usr/share/ca-certificates/minikubeCA.pem
	I0414 11:44:45.154053  818978 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0414 11:44:45.166901  818978 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0414 11:44:45.182340  818978 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0414 11:44:45.188192  818978 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0414 11:44:45.188292  818978 kubeadm.go:392] StartCluster: {Name:embed-certs-680698 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:embed-certs-680698 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fal
se CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0414 11:44:45.188392  818978 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0414 11:44:45.188470  818978 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0414 11:44:45.263448  818978 cri.go:89] found id: ""
	I0414 11:44:45.263638  818978 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0414 11:44:45.279655  818978 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0414 11:44:45.296498  818978 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0414 11:44:45.296799  818978 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0414 11:44:45.321240  818978 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0414 11:44:45.321331  818978 kubeadm.go:157] found existing configuration files:
	
	I0414 11:44:45.321875  818978 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0414 11:44:45.341032  818978 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0414 11:44:45.341148  818978 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0414 11:44:45.353869  818978 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0414 11:44:45.366643  818978 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0414 11:44:45.366770  818978 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0414 11:44:45.376436  818978 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0414 11:44:45.389386  818978 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0414 11:44:45.389489  818978 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0414 11:44:45.399200  818978 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0414 11:44:45.409184  818978 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0414 11:44:45.409249  818978 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0414 11:44:45.419132  818978 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.32.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0414 11:44:45.466050  818978 kubeadm.go:310] [init] Using Kubernetes version: v1.32.2
	I0414 11:44:45.466165  818978 kubeadm.go:310] [preflight] Running pre-flight checks
	I0414 11:44:45.487500  818978 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
	I0414 11:44:45.487698  818978 kubeadm.go:310] KERNEL_VERSION: 5.15.0-1081-aws
	I0414 11:44:45.487748  818978 kubeadm.go:310] OS: Linux
	I0414 11:44:45.487817  818978 kubeadm.go:310] CGROUPS_CPU: enabled
	I0414 11:44:45.487887  818978 kubeadm.go:310] CGROUPS_CPUACCT: enabled
	I0414 11:44:45.487975  818978 kubeadm.go:310] CGROUPS_CPUSET: enabled
	I0414 11:44:45.488055  818978 kubeadm.go:310] CGROUPS_DEVICES: enabled
	I0414 11:44:45.488142  818978 kubeadm.go:310] CGROUPS_FREEZER: enabled
	I0414 11:44:45.488224  818978 kubeadm.go:310] CGROUPS_MEMORY: enabled
	I0414 11:44:45.488301  818978 kubeadm.go:310] CGROUPS_PIDS: enabled
	I0414 11:44:45.488381  818978 kubeadm.go:310] CGROUPS_HUGETLB: enabled
	I0414 11:44:45.488476  818978 kubeadm.go:310] CGROUPS_BLKIO: enabled
	I0414 11:44:45.558804  818978 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0414 11:44:45.558994  818978 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0414 11:44:45.559198  818978 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
	I0414 11:44:45.566221  818978 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0414 11:44:45.572993  818978 out.go:235]   - Generating certificates and keys ...
	I0414 11:44:45.573113  818978 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0414 11:44:45.573236  818978 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0414 11:44:46.498002  818978 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0414 11:44:47.082859  818978 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
	I0414 11:44:47.666197  818978 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
	I0414 11:44:47.803431  808013 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0414 11:44:47.816139  808013 api_server.go:72] duration metric: took 5m55.681082464s to wait for apiserver process to appear ...
	I0414 11:44:47.816174  808013 api_server.go:88] waiting for apiserver healthz status ...
	I0414 11:44:47.816213  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0414 11:44:47.816268  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0414 11:44:47.872941  808013 cri.go:89] found id: "e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8"
	I0414 11:44:47.872961  808013 cri.go:89] found id: "461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42"
	I0414 11:44:47.872968  808013 cri.go:89] found id: ""
	I0414 11:44:47.872975  808013 logs.go:282] 2 containers: [e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8 461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42]
	I0414 11:44:47.873036  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:47.877393  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:47.881537  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0414 11:44:47.881608  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0414 11:44:47.951247  808013 cri.go:89] found id: "22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29"
	I0414 11:44:47.951266  808013 cri.go:89] found id: "dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c"
	I0414 11:44:47.951271  808013 cri.go:89] found id: ""
	I0414 11:44:47.951278  808013 logs.go:282] 2 containers: [22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29 dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c]
	I0414 11:44:47.951339  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:47.955570  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:47.960046  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0414 11:44:47.960114  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0414 11:44:48.016776  808013 cri.go:89] found id: "0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1"
	I0414 11:44:48.016798  808013 cri.go:89] found id: "33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507"
	I0414 11:44:48.016803  808013 cri.go:89] found id: ""
	I0414 11:44:48.016810  808013 logs.go:282] 2 containers: [0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1 33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507]
	I0414 11:44:48.016869  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.021594  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.026096  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0414 11:44:48.026187  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0414 11:44:48.078498  808013 cri.go:89] found id: "1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e"
	I0414 11:44:48.078570  808013 cri.go:89] found id: "f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993"
	I0414 11:44:48.078588  808013 cri.go:89] found id: ""
	I0414 11:44:48.078612  808013 logs.go:282] 2 containers: [1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993]
	I0414 11:44:48.078706  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.083758  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.088172  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0414 11:44:48.088249  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0414 11:44:48.137517  808013 cri.go:89] found id: "79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803"
	I0414 11:44:48.137536  808013 cri.go:89] found id: "13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1"
	I0414 11:44:48.137541  808013 cri.go:89] found id: ""
	I0414 11:44:48.137549  808013 logs.go:282] 2 containers: [79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803 13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1]
	I0414 11:44:48.137605  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.142443  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.146807  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0414 11:44:48.146876  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0414 11:44:48.211322  808013 cri.go:89] found id: "2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6"
	I0414 11:44:48.211341  808013 cri.go:89] found id: "d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6"
	I0414 11:44:48.211346  808013 cri.go:89] found id: ""
	I0414 11:44:48.211353  808013 logs.go:282] 2 containers: [2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6 d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6]
	I0414 11:44:48.211419  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.215344  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.220867  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I0414 11:44:48.220986  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0414 11:44:48.290792  808013 cri.go:89] found id: "54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d"
	I0414 11:44:48.290868  808013 cri.go:89] found id: "e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265"
	I0414 11:44:48.290888  808013 cri.go:89] found id: ""
	I0414 11:44:48.290909  808013 logs.go:282] 2 containers: [54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265]
	I0414 11:44:48.290995  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.294782  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.298559  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0414 11:44:48.298692  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0414 11:44:48.342392  808013 cri.go:89] found id: "e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa"
	I0414 11:44:48.342467  808013 cri.go:89] found id: "daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9"
	I0414 11:44:48.342485  808013 cri.go:89] found id: ""
	I0414 11:44:48.342507  808013 logs.go:282] 2 containers: [e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9]
	I0414 11:44:48.342598  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.346339  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.349761  808013 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0414 11:44:48.349914  808013 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0414 11:44:48.401259  808013 cri.go:89] found id: "59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566"
	I0414 11:44:48.401283  808013 cri.go:89] found id: ""
	I0414 11:44:48.401291  808013 logs.go:282] 1 containers: [59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566]
	I0414 11:44:48.401374  808013 ssh_runner.go:195] Run: which crictl
	I0414 11:44:48.405041  808013 logs.go:123] Gathering logs for coredns [33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507] ...
	I0414 11:44:48.405061  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507"
	I0414 11:44:48.453766  808013 logs.go:123] Gathering logs for kube-controller-manager [d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6] ...
	I0414 11:44:48.453818  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6"
	I0414 11:44:48.531990  808013 logs.go:123] Gathering logs for kindnet [54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d] ...
	I0414 11:44:48.532069  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d"
	I0414 11:44:48.612437  808013 logs.go:123] Gathering logs for storage-provisioner [daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9] ...
	I0414 11:44:48.612515  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9"
	I0414 11:44:48.666338  808013 logs.go:123] Gathering logs for kube-apiserver [e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8] ...
	I0414 11:44:48.666414  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8"
	I0414 11:44:47.867784  818978 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
	I0414 11:44:48.196845  818978 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
	I0414 11:44:48.197398  818978 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [embed-certs-680698 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
	I0414 11:44:49.074426  818978 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
	I0414 11:44:49.074738  818978 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [embed-certs-680698 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
	I0414 11:44:49.404244  818978 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0414 11:44:49.637560  818978 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
	I0414 11:44:49.905414  818978 kubeadm.go:310] [certs] Generating "sa" key and public key
	I0414 11:44:49.905754  818978 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0414 11:44:50.134680  818978 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0414 11:44:50.768250  818978 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
	I0414 11:44:51.039108  818978 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0414 11:44:51.424572  818978 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0414 11:44:51.971790  818978 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0414 11:44:51.974034  818978 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0414 11:44:51.977799  818978 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0414 11:44:51.981075  818978 out.go:235]   - Booting up control plane ...
	I0414 11:44:51.981210  818978 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0414 11:44:51.981300  818978 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0414 11:44:51.981931  818978 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0414 11:44:51.993525  818978 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0414 11:44:52.000548  818978 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0414 11:44:52.000894  818978 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0414 11:44:52.108079  818978 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0414 11:44:52.108202  818978 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
	I0414 11:44:48.735137  808013 logs.go:123] Gathering logs for kube-apiserver [461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42] ...
	I0414 11:44:48.735212  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42"
	I0414 11:44:48.803249  808013 logs.go:123] Gathering logs for etcd [dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c] ...
	I0414 11:44:48.803325  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c"
	I0414 11:44:48.848323  808013 logs.go:123] Gathering logs for kube-proxy [79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803] ...
	I0414 11:44:48.848474  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803"
	I0414 11:44:48.915130  808013 logs.go:123] Gathering logs for kube-controller-manager [2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6] ...
	I0414 11:44:48.915200  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6"
	I0414 11:44:49.022893  808013 logs.go:123] Gathering logs for kindnet [e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265] ...
	I0414 11:44:49.022926  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265"
	I0414 11:44:49.095606  808013 logs.go:123] Gathering logs for kubernetes-dashboard [59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566] ...
	I0414 11:44:49.095676  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566"
	I0414 11:44:49.150412  808013 logs.go:123] Gathering logs for kubelet ...
	I0414 11:44:49.150492  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0414 11:44:49.229956  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.671664     661 reflector.go:138] object-"kube-system"/"kube-proxy-token-f29ww": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-f29ww" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.230231  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.678711     661 reflector.go:138] object-"kube-system"/"kindnet-token-srz8d": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-srz8d" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.230461  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.679945     661 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.230689  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.681204     661 reflector.go:138] object-"kube-system"/"coredns-token-lkmz8": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-lkmz8" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.230907  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.681667     661 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.231134  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.689142     661 reflector.go:138] object-"default"/"default-token-6r6dc": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-6r6dc" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.234893  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.710198     661 reflector.go:138] object-"kube-system"/"storage-provisioner-token-cbmxs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-cbmxs" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.235118  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:09 old-k8s-version-943255 kubelet[661]: E0414 11:39:09.823295     661 reflector.go:138] object-"kube-system"/"metrics-server-token-9hmzl": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-9hmzl" is forbidden: User "system:node:old-k8s-version-943255" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-943255' and this object
	W0414 11:44:49.243126  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:12 old-k8s-version-943255 kubelet[661]: E0414 11:39:12.493034     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:49.243360  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:12 old-k8s-version-943255 kubelet[661]: E0414 11:39:12.517194     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.246196  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:27 old-k8s-version-943255 kubelet[661]: E0414 11:39:27.201995     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:49.248284  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:34 old-k8s-version-943255 kubelet[661]: E0414 11:39:34.614078     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.248631  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:35 old-k8s-version-943255 kubelet[661]: E0414 11:39:35.636481     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.249036  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:36 old-k8s-version-943255 kubelet[661]: E0414 11:39:36.642188     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.249240  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:39 old-k8s-version-943255 kubelet[661]: E0414 11:39:39.192063     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.250082  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:42 old-k8s-version-943255 kubelet[661]: E0414 11:39:42.656633     661 pod_workers.go:191] Error syncing pod 70b78d06-fcec-4cd3-9143-9c2bd9176c52 ("storage-provisioner_kube-system(70b78d06-fcec-4cd3-9143-9c2bd9176c52)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(70b78d06-fcec-4cd3-9143-9c2bd9176c52)"
	W0414 11:44:49.250700  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:47 old-k8s-version-943255 kubelet[661]: E0414 11:39:47.688060     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.253604  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:54 old-k8s-version-943255 kubelet[661]: E0414 11:39:54.213195     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:49.253942  808013 logs.go:138] Found kubelet problem: Apr 14 11:39:55 old-k8s-version-943255 kubelet[661]: E0414 11:39:55.053328     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.254482  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:09 old-k8s-version-943255 kubelet[661]: E0414 11:40:09.192116     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.255118  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:10 old-k8s-version-943255 kubelet[661]: E0414 11:40:10.769424     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.255538  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:15 old-k8s-version-943255 kubelet[661]: E0414 11:40:15.053424     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.255724  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:24 old-k8s-version-943255 kubelet[661]: E0414 11:40:24.192449     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.256047  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:27 old-k8s-version-943255 kubelet[661]: E0414 11:40:27.191843     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.258929  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:38 old-k8s-version-943255 kubelet[661]: E0414 11:40:38.205282     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:49.259299  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:39 old-k8s-version-943255 kubelet[661]: E0414 11:40:39.191989     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.259508  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:49 old-k8s-version-943255 kubelet[661]: E0414 11:40:49.192230     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.260116  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:53 old-k8s-version-943255 kubelet[661]: E0414 11:40:53.882336     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.260460  808013 logs.go:138] Found kubelet problem: Apr 14 11:40:55 old-k8s-version-943255 kubelet[661]: E0414 11:40:55.053117     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.260682  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:02 old-k8s-version-943255 kubelet[661]: E0414 11:41:02.195946     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.261040  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:06 old-k8s-version-943255 kubelet[661]: E0414 11:41:06.191978     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.261245  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:13 old-k8s-version-943255 kubelet[661]: E0414 11:41:13.192235     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.261591  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:21 old-k8s-version-943255 kubelet[661]: E0414 11:41:21.191820     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.261806  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:25 old-k8s-version-943255 kubelet[661]: E0414 11:41:25.192141     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.262151  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:34 old-k8s-version-943255 kubelet[661]: E0414 11:41:34.191786     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.262353  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:39 old-k8s-version-943255 kubelet[661]: E0414 11:41:39.192207     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.262702  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:47 old-k8s-version-943255 kubelet[661]: E0414 11:41:47.191837     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.262902  808013 logs.go:138] Found kubelet problem: Apr 14 11:41:52 old-k8s-version-943255 kubelet[661]: E0414 11:41:52.194045     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.263247  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:00 old-k8s-version-943255 kubelet[661]: E0414 11:42:00.196599     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.265879  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:04 old-k8s-version-943255 kubelet[661]: E0414 11:42:04.200603     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0414 11:44:49.266542  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:16 old-k8s-version-943255 kubelet[661]: E0414 11:42:16.072747     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.266749  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:18 old-k8s-version-943255 kubelet[661]: E0414 11:42:18.200708     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.267094  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:25 old-k8s-version-943255 kubelet[661]: E0414 11:42:25.053597     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.267293  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:30 old-k8s-version-943255 kubelet[661]: E0414 11:42:30.192906     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.267657  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:37 old-k8s-version-943255 kubelet[661]: E0414 11:42:37.192466     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.267861  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:41 old-k8s-version-943255 kubelet[661]: E0414 11:42:41.192467     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.268203  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:49 old-k8s-version-943255 kubelet[661]: E0414 11:42:49.191798     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.268402  808013 logs.go:138] Found kubelet problem: Apr 14 11:42:52 old-k8s-version-943255 kubelet[661]: E0414 11:42:52.192457     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.268863  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:01 old-k8s-version-943255 kubelet[661]: E0414 11:43:01.191833     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.269073  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:04 old-k8s-version-943255 kubelet[661]: E0414 11:43:04.193465     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.269419  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:13 old-k8s-version-943255 kubelet[661]: E0414 11:43:13.191790     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.269619  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:19 old-k8s-version-943255 kubelet[661]: E0414 11:43:19.192065     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.269970  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:25 old-k8s-version-943255 kubelet[661]: E0414 11:43:25.191821     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.270175  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:33 old-k8s-version-943255 kubelet[661]: E0414 11:43:33.192850     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.270517  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:39 old-k8s-version-943255 kubelet[661]: E0414 11:43:39.191923     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.270717  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:48 old-k8s-version-943255 kubelet[661]: E0414 11:43:48.192882     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.271077  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:54 old-k8s-version-943255 kubelet[661]: E0414 11:43:54.192005     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.271281  808013 logs.go:138] Found kubelet problem: Apr 14 11:43:59 old-k8s-version-943255 kubelet[661]: E0414 11:43:59.193181     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.271688  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:05 old-k8s-version-943255 kubelet[661]: E0414 11:44:05.192322     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.271908  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:11 old-k8s-version-943255 kubelet[661]: E0414 11:44:11.192365     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.272252  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:16 old-k8s-version-943255 kubelet[661]: E0414 11:44:16.192478     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.272455  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:23 old-k8s-version-943255 kubelet[661]: E0414 11:44:23.192167     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.272804  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:29 old-k8s-version-943255 kubelet[661]: E0414 11:44:29.194021     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.273004  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:37 old-k8s-version-943255 kubelet[661]: E0414 11:44:37.193029     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.273348  808013 logs.go:138] Found kubelet problem: Apr 14 11:44:41 old-k8s-version-943255 kubelet[661]: E0414 11:44:41.192234     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	I0414 11:44:49.273379  808013 logs.go:123] Gathering logs for describe nodes ...
	I0414 11:44:49.273408  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0414 11:44:49.445671  808013 logs.go:123] Gathering logs for coredns [0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1] ...
	I0414 11:44:49.445743  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1"
	I0414 11:44:49.499885  808013 logs.go:123] Gathering logs for kube-proxy [13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1] ...
	I0414 11:44:49.499954  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1"
	I0414 11:44:49.558047  808013 logs.go:123] Gathering logs for containerd ...
	I0414 11:44:49.558124  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0414 11:44:49.621804  808013 logs.go:123] Gathering logs for container status ...
	I0414 11:44:49.621880  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0414 11:44:49.685699  808013 logs.go:123] Gathering logs for dmesg ...
	I0414 11:44:49.685873  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0414 11:44:49.708488  808013 logs.go:123] Gathering logs for kube-scheduler [1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e] ...
	I0414 11:44:49.708560  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e"
	I0414 11:44:49.761525  808013 logs.go:123] Gathering logs for kube-scheduler [f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993] ...
	I0414 11:44:49.761595  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993"
	I0414 11:44:49.816691  808013 logs.go:123] Gathering logs for storage-provisioner [e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa] ...
	I0414 11:44:49.816767  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa"
	I0414 11:44:49.871098  808013 logs.go:123] Gathering logs for etcd [22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29] ...
	I0414 11:44:49.871168  808013 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29"
	I0414 11:44:49.957340  808013 out.go:358] Setting ErrFile to fd 2...
	I0414 11:44:49.957368  808013 out.go:392] TERM=,COLORTERM=, which probably does not support color
	W0414 11:44:49.957436  808013 out.go:270] X Problems detected in kubelet:
	W0414 11:44:49.957445  808013 out.go:270]   Apr 14 11:44:16 old-k8s-version-943255 kubelet[661]: E0414 11:44:16.192478     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.957453  808013 out.go:270]   Apr 14 11:44:23 old-k8s-version-943255 kubelet[661]: E0414 11:44:23.192167     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.957460  808013 out.go:270]   Apr 14 11:44:29 old-k8s-version-943255 kubelet[661]: E0414 11:44:29.194021     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	W0414 11:44:49.957467  808013 out.go:270]   Apr 14 11:44:37 old-k8s-version-943255 kubelet[661]: E0414 11:44:37.193029     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0414 11:44:49.957542  808013 out.go:270]   Apr 14 11:44:41 old-k8s-version-943255 kubelet[661]: E0414 11:44:41.192234     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	I0414 11:44:49.957550  808013 out.go:358] Setting ErrFile to fd 2...
	I0414 11:44:49.957557  808013 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:44:53.109066  818978 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001131978s
	I0414 11:44:53.109164  818978 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
	I0414 11:44:59.111324  818978 kubeadm.go:310] [api-check] The API server is healthy after 6.002407495s
	I0414 11:44:59.149142  818978 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0414 11:44:59.164948  818978 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0414 11:44:59.190928  818978 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0414 11:44:59.191429  818978 kubeadm.go:310] [mark-control-plane] Marking the node embed-certs-680698 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0414 11:44:59.202836  818978 kubeadm.go:310] [bootstrap-token] Using token: kg4s4v.d30eepdqvj0q3gxy
	I0414 11:44:59.959458  808013 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0414 11:44:59.970865  808013 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0414 11:44:59.974990  808013 out.go:201] 
	W0414 11:44:59.978044  808013 out.go:270] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	W0414 11:44:59.978134  808013 out.go:270] * Suggestion: Control Plane could not update, try minikube delete --all --purge
	W0414 11:44:59.978193  808013 out.go:270] * Related issue: https://github.com/kubernetes/minikube/issues/11417
	W0414 11:44:59.978233  808013 out.go:270] * 
	W0414 11:44:59.979165  808013 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0414 11:44:59.983029  808013 out.go:201] 
	I0414 11:44:59.205847  818978 out.go:235]   - Configuring RBAC rules ...
	I0414 11:44:59.205986  818978 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0414 11:44:59.211140  818978 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0414 11:44:59.219705  818978 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0414 11:44:59.223914  818978 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0414 11:44:59.228750  818978 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0414 11:44:59.235203  818978 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0414 11:44:59.519816  818978 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0414 11:44:59.950350  818978 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0414 11:45:00.592822  818978 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0414 11:45:00.592858  818978 kubeadm.go:310] 
	I0414 11:45:00.592921  818978 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0414 11:45:00.592939  818978 kubeadm.go:310] 
	I0414 11:45:00.593020  818978 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0414 11:45:00.593031  818978 kubeadm.go:310] 
	I0414 11:45:00.593059  818978 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0414 11:45:00.599709  818978 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0414 11:45:00.599793  818978 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0414 11:45:00.599799  818978 kubeadm.go:310] 
	I0414 11:45:00.599854  818978 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0414 11:45:00.599866  818978 kubeadm.go:310] 
	I0414 11:45:00.599914  818978 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0414 11:45:00.599923  818978 kubeadm.go:310] 
	I0414 11:45:00.599975  818978 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0414 11:45:00.600054  818978 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0414 11:45:00.600126  818978 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0414 11:45:00.600139  818978 kubeadm.go:310] 
	I0414 11:45:00.600223  818978 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0414 11:45:00.600305  818978 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0414 11:45:00.600313  818978 kubeadm.go:310] 
	I0414 11:45:00.600396  818978 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token kg4s4v.d30eepdqvj0q3gxy \
	I0414 11:45:00.600502  818978 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:22ecde837dc4537a4ceb7238aee543ce73e2d995effa034a90e0e1ab45e4d9f0 \
	I0414 11:45:00.607674  818978 kubeadm.go:310] 	--control-plane 
	I0414 11:45:00.607718  818978 kubeadm.go:310] 
	I0414 11:45:00.607931  818978 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0414 11:45:00.607946  818978 kubeadm.go:310] 
	I0414 11:45:00.611736  818978 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token kg4s4v.d30eepdqvj0q3gxy \
	I0414 11:45:00.611861  818978 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:22ecde837dc4537a4ceb7238aee543ce73e2d995effa034a90e0e1ab45e4d9f0 
	I0414 11:45:00.630731  818978 kubeadm.go:310] 	[WARNING SystemVerification]: cgroups v1 support is in maintenance mode, please migrate to cgroups v2
	I0414 11:45:00.631076  818978 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1081-aws\n", err: exit status 1
	I0414 11:45:00.632442  818978 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0414 11:45:00.632653  818978 cni.go:84] Creating CNI manager for ""
	I0414 11:45:00.632665  818978 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0414 11:45:00.649583  818978 out.go:177] * Configuring CNI (Container Networking Interface) ...
	
	
	==> container status <==
	CONTAINER           IMAGE               CREATED             STATE               NAME                        ATTEMPT             POD ID              POD
	f3fe1f3572c03       523cad1a4df73       6 seconds ago       Exited              dashboard-metrics-scraper   6                   e9a4791ec4452       dashboard-metrics-scraper-8d5bb5db8-jpjgb
	e91667bb9e4d3       ba04bb24b9575       5 minutes ago       Running             storage-provisioner         2                   423b2106855db       storage-provisioner
	59b5daad610a9       20b332c9a70d8       5 minutes ago       Running             kubernetes-dashboard        0                   a6fe2dc10abb5       kubernetes-dashboard-cd95d586-xntzk
	0dc5268e64369       db91994f4ee8f       5 minutes ago       Running             coredns                     1                   ed34217a07d4e       coredns-74ff55c5b-b6hq8
	e4d8d84c967c0       1611cd07b61d5       5 minutes ago       Running             busybox                     1                   ca6aa6a43dd65       busybox
	79c9b42c48cf9       25a5233254979       5 minutes ago       Running             kube-proxy                  1                   0dd36abac3925       kube-proxy-rhrdw
	daf4175e5b7ab       ba04bb24b9575       5 minutes ago       Exited              storage-provisioner         1                   423b2106855db       storage-provisioner
	54fee462d7048       ee75e27fff91c       5 minutes ago       Running             kindnet-cni                 1                   04c1389f6b73d       kindnet-fv898
	2a5a538079e46       1df8a2b116bd1       6 minutes ago       Running             kube-controller-manager     1                   1aac355b9eb0b       kube-controller-manager-old-k8s-version-943255
	1fccd9ab2f416       e7605f88f17d6       6 minutes ago       Running             kube-scheduler              1                   c916ba8394977       kube-scheduler-old-k8s-version-943255
	e808a7edc1bef       2c08bbbc02d3a       6 minutes ago       Running             kube-apiserver              1                   b91e01e9fcbea       kube-apiserver-old-k8s-version-943255
	22d59329be272       05b738aa1bc63       6 minutes ago       Running             etcd                        1                   62c352b9c032a       etcd-old-k8s-version-943255
	b076f2385bb51       1611cd07b61d5       6 minutes ago       Exited              busybox                     0                   9346d4f4a47f4       busybox
	33df1ca9d1f5d       db91994f4ee8f       7 minutes ago       Exited              coredns                     0                   5d8b4e5a3c858       coredns-74ff55c5b-b6hq8
	e3ab91cc88a5c       ee75e27fff91c       8 minutes ago       Exited              kindnet-cni                 0                   dbf21b3272b8c       kindnet-fv898
	13c73f9eba669       25a5233254979       8 minutes ago       Exited              kube-proxy                  0                   3306d22277985       kube-proxy-rhrdw
	dfb87161c5c5f       05b738aa1bc63       8 minutes ago       Exited              etcd                        0                   af9f7228c6c3f       etcd-old-k8s-version-943255
	461bce20618e7       2c08bbbc02d3a       8 minutes ago       Exited              kube-apiserver              0                   d2c785f3da3bc       kube-apiserver-old-k8s-version-943255
	d980a0c3a521a       1df8a2b116bd1       8 minutes ago       Exited              kube-controller-manager     0                   8af0c81f4b002       kube-controller-manager-old-k8s-version-943255
	f0cc66fe654db       e7605f88f17d6       8 minutes ago       Exited              kube-scheduler              0                   c0925ae2464e5       kube-scheduler-old-k8s-version-943255
	
	
	==> containerd <==
	Apr 14 11:42:04 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:42:04.200149237Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
	Apr 14 11:42:15 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:42:15.193641511Z" level=info msg="CreateContainer within sandbox \"e9a4791ec445280a9e44a4c23f8e7ce40f03f361e69f03e544b40eb1ee17fe83\" for container name:\"dashboard-metrics-scraper\" attempt:5"
	Apr 14 11:42:15 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:42:15.215691186Z" level=info msg="CreateContainer within sandbox \"e9a4791ec445280a9e44a4c23f8e7ce40f03f361e69f03e544b40eb1ee17fe83\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46\""
	Apr 14 11:42:15 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:42:15.216399599Z" level=info msg="StartContainer for \"d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46\""
	Apr 14 11:42:15 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:42:15.295386415Z" level=info msg="StartContainer for \"d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46\" returns successfully"
	Apr 14 11:42:15 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:42:15.295593449Z" level=info msg="received exit event container_id:\"d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46\" id:\"d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46\" pid:3276 exit_status:255 exited_at:{seconds:1744630935 nanos:294108987}"
	Apr 14 11:42:15 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:42:15.335379065Z" level=info msg="shim disconnected" id=d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46 namespace=k8s.io
	Apr 14 11:42:15 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:42:15.335422314Z" level=warning msg="cleaning up after shim disconnected" id=d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46 namespace=k8s.io
	Apr 14 11:42:15 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:42:15.335459541Z" level=info msg="cleaning up dead shim" namespace=k8s.io
	Apr 14 11:42:16 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:42:16.079287494Z" level=info msg="RemoveContainer for \"f10391e31ef584b4e3e330d714dd768ed468d59ffa0c5b044a7e992a63c6608a\""
	Apr 14 11:42:16 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:42:16.085418223Z" level=info msg="RemoveContainer for \"f10391e31ef584b4e3e330d714dd768ed468d59ffa0c5b044a7e992a63c6608a\" returns successfully"
	Apr 14 11:44:49 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:44:49.196866524Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Apr 14 11:44:49 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:44:49.215848384Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
	Apr 14 11:44:49 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:44:49.217997160Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	Apr 14 11:44:49 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:44:49.218021489Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
	Apr 14 11:44:56 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:44:56.194550762Z" level=info msg="CreateContainer within sandbox \"e9a4791ec445280a9e44a4c23f8e7ce40f03f361e69f03e544b40eb1ee17fe83\" for container name:\"dashboard-metrics-scraper\" attempt:6"
	Apr 14 11:44:56 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:44:56.226595077Z" level=info msg="CreateContainer within sandbox \"e9a4791ec445280a9e44a4c23f8e7ce40f03f361e69f03e544b40eb1ee17fe83\" for name:\"dashboard-metrics-scraper\" attempt:6 returns container id \"f3fe1f3572c032d372784638fc602d8ef649f2ab7feefa7bf203c9122260a145\""
	Apr 14 11:44:56 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:44:56.227417486Z" level=info msg="StartContainer for \"f3fe1f3572c032d372784638fc602d8ef649f2ab7feefa7bf203c9122260a145\""
	Apr 14 11:44:56 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:44:56.372687920Z" level=info msg="StartContainer for \"f3fe1f3572c032d372784638fc602d8ef649f2ab7feefa7bf203c9122260a145\" returns successfully"
	Apr 14 11:44:56 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:44:56.372872102Z" level=info msg="received exit event container_id:\"f3fe1f3572c032d372784638fc602d8ef649f2ab7feefa7bf203c9122260a145\" id:\"f3fe1f3572c032d372784638fc602d8ef649f2ab7feefa7bf203c9122260a145\" pid:4150 exit_status:255 exited_at:{seconds:1744631096 nanos:362762223}"
	Apr 14 11:44:56 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:44:56.413084940Z" level=info msg="shim disconnected" id=f3fe1f3572c032d372784638fc602d8ef649f2ab7feefa7bf203c9122260a145 namespace=k8s.io
	Apr 14 11:44:56 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:44:56.413137806Z" level=warning msg="cleaning up after shim disconnected" id=f3fe1f3572c032d372784638fc602d8ef649f2ab7feefa7bf203c9122260a145 namespace=k8s.io
	Apr 14 11:44:56 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:44:56.413183476Z" level=info msg="cleaning up dead shim" namespace=k8s.io
	Apr 14 11:44:56 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:44:56.539324495Z" level=info msg="RemoveContainer for \"d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46\""
	Apr 14 11:44:56 old-k8s-version-943255 containerd[566]: time="2025-04-14T11:44:56.545506385Z" level=info msg="RemoveContainer for \"d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46\" returns successfully"
	
	
	==> coredns [0dc5268e643699428766a750f28dd24413e9c1379a724c6a12733bf9bf65c8e1] <==
	.:53
	[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
	CoreDNS-1.7.0
	linux/arm64, go1.14.4, f59c03d
	[INFO] 127.0.0.1:50022 - 40847 "HINFO IN 6490487655711766354.1282092218908823369. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.013696835s
	
	
	==> coredns [33df1ca9d1f5de23c3ebb4110e2f15f04455f6002c42d308dd69b327f0b59507] <==
	.:53
	[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
	CoreDNS-1.7.0
	linux/arm64, go1.14.4, f59c03d
	[INFO] 127.0.0.1:60157 - 9502 "HINFO IN 5508542050163006861.897983388254840484. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.014414709s
	
	
	==> describe nodes <==
	Name:               old-k8s-version-943255
	Roles:              control-plane,master
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=old-k8s-version-943255
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=43cb59e6a4e9845c84b0379fb52045b7420d26a4
	                    minikube.k8s.io/name=old-k8s-version-943255
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2025_04_14T11_36_30_0700
	                    minikube.k8s.io/version=v1.35.0
	                    node-role.kubernetes.io/control-plane=
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 14 Apr 2025 11:36:26 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  old-k8s-version-943255
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 14 Apr 2025 11:44:52 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 14 Apr 2025 11:40:00 +0000   Mon, 14 Apr 2025 11:36:20 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 14 Apr 2025 11:40:00 +0000   Mon, 14 Apr 2025 11:36:20 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 14 Apr 2025 11:40:00 +0000   Mon, 14 Apr 2025 11:36:20 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 14 Apr 2025 11:40:00 +0000   Mon, 14 Apr 2025 11:36:45 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.76.2
	  Hostname:    old-k8s-version-943255
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022300Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022300Ki
	  pods:               110
	System Info:
	  Machine ID:                 fa6e97d519954b899d35715e9fe04be2
	  System UUID:                d681882a-b787-4229-93af-fcb62eb82611
	  Boot ID:                    59456904-b420-460f-bf6e-42b382cceb7f
	  Kernel Version:             5.15.0-1081-aws
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  containerd://1.7.27
	  Kubelet Version:            v1.20.0
	  Kube-Proxy Version:         v1.20.0
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (12 in total)
	  Namespace                   Name                                              CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                   ----                                              ------------  ----------  ---------------  -------------  ---
	  default                     busybox                                           0 (0%)        0 (0%)      0 (0%)           0 (0%)         6m42s
	  kube-system                 coredns-74ff55c5b-b6hq8                           100m (5%)     0 (0%)      70Mi (0%)        170Mi (2%)     8m17s
	  kube-system                 etcd-old-k8s-version-943255                       100m (5%)     0 (0%)      100Mi (1%)       0 (0%)         8m24s
	  kube-system                 kindnet-fv898                                     100m (5%)     100m (5%)   50Mi (0%)        50Mi (0%)      8m17s
	  kube-system                 kube-apiserver-old-k8s-version-943255             250m (12%)    0 (0%)      0 (0%)           0 (0%)         8m24s
	  kube-system                 kube-controller-manager-old-k8s-version-943255    200m (10%)    0 (0%)      0 (0%)           0 (0%)         8m24s
	  kube-system                 kube-proxy-rhrdw                                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         8m17s
	  kube-system                 kube-scheduler-old-k8s-version-943255             100m (5%)     0 (0%)      0 (0%)           0 (0%)         8m24s
	  kube-system                 metrics-server-9975d5f86-7rqxd                    100m (5%)     0 (0%)      200Mi (2%)       0 (0%)         6m31s
	  kube-system                 storage-provisioner                               0 (0%)        0 (0%)      0 (0%)           0 (0%)         8m16s
	  kubernetes-dashboard        dashboard-metrics-scraper-8d5bb5db8-jpjgb         0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m35s
	  kubernetes-dashboard        kubernetes-dashboard-cd95d586-xntzk               0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m35s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (47%)  100m (5%)
	  memory             420Mi (5%)  220Mi (2%)
	  ephemeral-storage  100Mi (0%)  0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	  hugepages-32Mi     0 (0%)      0 (0%)
	  hugepages-64Ki     0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                    From        Message
	  ----    ------                   ----                   ----        -------
	  Normal  NodeHasSufficientMemory  8m43s (x5 over 8m44s)  kubelet     Node old-k8s-version-943255 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    8m43s (x4 over 8m44s)  kubelet     Node old-k8s-version-943255 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     8m43s (x4 over 8m44s)  kubelet     Node old-k8s-version-943255 status is now: NodeHasSufficientPID
	  Normal  Starting                 8m25s                  kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  8m25s                  kubelet     Node old-k8s-version-943255 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    8m25s                  kubelet     Node old-k8s-version-943255 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     8m25s                  kubelet     Node old-k8s-version-943255 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  8m24s                  kubelet     Updated Node Allocatable limit across pods
	  Normal  NodeReady                8m17s                  kubelet     Node old-k8s-version-943255 status is now: NodeReady
	  Normal  Starting                 8m16s                  kube-proxy  Starting kube-proxy.
	  Normal  Starting                 6m3s                   kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  6m2s (x8 over 6m2s)    kubelet     Node old-k8s-version-943255 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    6m2s (x8 over 6m2s)    kubelet     Node old-k8s-version-943255 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     6m2s (x7 over 6m2s)    kubelet     Node old-k8s-version-943255 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  6m2s                   kubelet     Updated Node Allocatable limit across pods
	  Normal  Starting                 5m50s                  kube-proxy  Starting kube-proxy.
	
	
	==> dmesg <==
	[Apr14 10:26] overlayfs: '/var/lib/containers/storage/overlay/l/N5ED6J4JNM6I34BFXJDCBYNTX3' not a directory
	[  +0.017885] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
	[  +0.033761] overlayfs: '/var/lib/containers/storage/overlay/l/7FOWQIVXOWACA56BLQVF4JJOLY' not a directory
	[  +0.764468] overlayfs: '/var/lib/containers/storage/overlay/l/N5ED6J4JNM6I34BFXJDCBYNTX3' not a directory
	
	
	==> etcd [22d59329be2729230f45f19e03b62c9b7b86d70082fd6293ab1864c24801ae29] <==
	2025-04-14 11:40:53.988681 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:41:03.988567 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:41:13.988615 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:41:23.988641 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:41:33.988530 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:41:43.988685 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:41:53.988541 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:42:03.988604 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:42:13.988478 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:42:23.988524 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:42:33.989146 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:42:43.988618 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:42:53.988565 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:43:03.988715 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:43:13.988561 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:43:23.988608 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:43:33.989081 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:43:43.988582 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:43:53.988560 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:44:03.988662 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:44:13.988573 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:44:23.988530 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:44:33.988654 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:44:43.988652 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:44:53.988800 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	
	
	==> etcd [dfb87161c5c5fc49006ebdce3f7601957819ec445b865541e146eca0679b5a2c] <==
	2025-04-14 11:36:20.019170 I | embed: listening for peers on 192.168.76.2:2380
	raft2025/04/14 11:36:20 INFO: ea7e25599daad906 is starting a new election at term 1
	raft2025/04/14 11:36:20 INFO: ea7e25599daad906 became candidate at term 2
	raft2025/04/14 11:36:20 INFO: ea7e25599daad906 received MsgVoteResp from ea7e25599daad906 at term 2
	raft2025/04/14 11:36:20 INFO: ea7e25599daad906 became leader at term 2
	raft2025/04/14 11:36:20 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
	2025-04-14 11:36:20.154594 I | etcdserver: published {Name:old-k8s-version-943255 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
	2025-04-14 11:36:20.154886 I | embed: ready to serve client requests
	2025-04-14 11:36:20.156353 I | embed: serving client requests on 192.168.76.2:2379
	2025-04-14 11:36:20.157056 I | etcdserver: setting up the initial cluster version to 3.4
	2025-04-14 11:36:20.167495 I | embed: ready to serve client requests
	2025-04-14 11:36:20.168935 N | etcdserver/membership: set the initial cluster version to 3.4
	2025-04-14 11:36:20.169176 I | embed: serving client requests on 127.0.0.1:2379
	2025-04-14 11:36:20.177865 I | etcdserver/api: enabled capabilities for version 3.4
	2025-04-14 11:36:47.843090 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:36:51.656129 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:37:01.655973 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:37:11.655933 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:37:21.656102 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:37:31.655945 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:37:41.655984 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:37:51.655926 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:38:01.656273 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:38:11.656141 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2025-04-14 11:38:21.656079 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	
	
	==> kernel <==
	 11:45:02 up  3:27,  0 users,  load average: 3.59, 2.17, 2.45
	Linux old-k8s-version-943255 5.15.0-1081-aws #88~20.04.1-Ubuntu SMP Fri Mar 28 14:48:25 UTC 2025 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [54fee462d7048537e2d6e5b1ff04e1a355a5529a85df9db91a1a0c4fc0c0135d] <==
	I0414 11:43:02.359897       1 main.go:301] handling current node
	I0414 11:43:12.350562       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:43:12.350600       1 main.go:301] handling current node
	I0414 11:43:22.355304       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:43:22.355341       1 main.go:301] handling current node
	I0414 11:43:32.357885       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:43:32.358053       1 main.go:301] handling current node
	I0414 11:43:42.359523       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:43:42.359560       1 main.go:301] handling current node
	I0414 11:43:52.357046       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:43:52.357085       1 main.go:301] handling current node
	I0414 11:44:02.358894       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:44:02.359038       1 main.go:301] handling current node
	I0414 11:44:12.350552       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:44:12.350586       1 main.go:301] handling current node
	I0414 11:44:22.357083       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:44:22.357117       1 main.go:301] handling current node
	I0414 11:44:32.359936       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:44:32.360149       1 main.go:301] handling current node
	I0414 11:44:42.357998       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:44:42.358032       1 main.go:301] handling current node
	I0414 11:44:52.356208       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:44:52.356250       1 main.go:301] handling current node
	I0414 11:45:02.354028       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:45:02.354071       1 main.go:301] handling current node
	
	
	==> kindnet [e3ab91cc88a5cea8def919348a0aaefa8482399763cb8271c570074b36d6a265] <==
	I0414 11:36:48.634879       1 controller.go:365] Waiting for informer caches to sync
	I0414 11:36:48.634886       1 shared_informer.go:313] Waiting for caches to sync for kube-network-policies
	I0414 11:36:48.935102       1 shared_informer.go:320] Caches are synced for kube-network-policies
	I0414 11:36:48.935275       1 metrics.go:61] Registering metrics
	I0414 11:36:48.935411       1 controller.go:401] Syncing nftables rules
	I0414 11:36:58.641851       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:36:58.641893       1 main.go:301] handling current node
	I0414 11:37:08.634293       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:37:08.634391       1 main.go:301] handling current node
	I0414 11:37:18.637643       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:37:18.637750       1 main.go:301] handling current node
	I0414 11:37:28.642497       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:37:28.642532       1 main.go:301] handling current node
	I0414 11:37:38.643007       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:37:38.643040       1 main.go:301] handling current node
	I0414 11:37:48.634851       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:37:48.634885       1 main.go:301] handling current node
	I0414 11:37:58.634918       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:37:58.634955       1 main.go:301] handling current node
	I0414 11:38:08.636036       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:38:08.636933       1 main.go:301] handling current node
	I0414 11:38:18.635739       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:38:18.635769       1 main.go:301] handling current node
	I0414 11:38:28.637890       1 main.go:297] Handling node with IPs: map[192.168.76.2:{}]
	I0414 11:38:28.637980       1 main.go:301] handling current node
	
	
	==> kube-apiserver [461bce20618e7e65ba72755643928d40207b8ccf6203f0954e747fd82c980d42] <==
	I0414 11:36:27.283463       1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I0414 11:36:27.283684       1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0414 11:36:27.306303       1 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000
	I0414 11:36:27.311193       1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
	I0414 11:36:27.311218       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
	I0414 11:36:27.765183       1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0414 11:36:27.805121       1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W0414 11:36:27.949212       1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
	I0414 11:36:27.950226       1 controller.go:606] quota admission added evaluator for: endpoints
	I0414 11:36:27.953509       1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0414 11:36:28.247115       1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
	I0414 11:36:28.917625       1 controller.go:606] quota admission added evaluator for: serviceaccounts
	I0414 11:36:29.378688       1 controller.go:606] quota admission added evaluator for: deployments.apps
	I0414 11:36:29.423142       1 controller.go:606] quota admission added evaluator for: daemonsets.apps
	I0414 11:36:45.155966       1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
	I0414 11:36:45.173948       1 controller.go:606] quota admission added evaluator for: replicasets.apps
	I0414 11:37:00.692857       1 client.go:360] parsed scheme: "passthrough"
	I0414 11:37:00.692897       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0414 11:37:00.692906       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0414 11:37:33.387948       1 client.go:360] parsed scheme: "passthrough"
	I0414 11:37:33.387990       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0414 11:37:33.388023       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0414 11:38:06.204038       1 client.go:360] parsed scheme: "passthrough"
	I0414 11:38:06.204347       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0414 11:38:06.204441       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	
	
	==> kube-apiserver [e808a7edc1bef543a4087d91ae5c2ee0e55080a7ebbb9d2b1aca1f9ef59584a8] <==
	I0414 11:41:34.287807       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0414 11:41:34.287815       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0414 11:42:08.796006       1 client.go:360] parsed scheme: "passthrough"
	I0414 11:42:08.796275       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0414 11:42:08.796397       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	W0414 11:42:12.289018       1 handler_proxy.go:102] no RequestInfo found in the context
	E0414 11:42:12.289240       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0414 11:42:12.289259       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0414 11:42:45.869146       1 client.go:360] parsed scheme: "passthrough"
	I0414 11:42:45.869187       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0414 11:42:45.869196       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0414 11:43:26.374758       1 client.go:360] parsed scheme: "passthrough"
	I0414 11:43:26.374822       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0414 11:43:26.374855       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0414 11:44:08.793534       1 client.go:360] parsed scheme: "passthrough"
	I0414 11:44:08.793581       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0414 11:44:08.793589       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	W0414 11:44:10.809696       1 handler_proxy.go:102] no RequestInfo found in the context
	E0414 11:44:10.809963       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0414 11:44:10.809982       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0414 11:44:44.711062       1 client.go:360] parsed scheme: "passthrough"
	I0414 11:44:44.711105       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0414 11:44:44.711114       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	
	
	==> kube-controller-manager [2a5a538079e469c67b6e5ff15238d2e56b50b050adec15288668075ef4d1f8e6] <==
	W0414 11:40:35.602638       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0414 11:40:59.295341       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0414 11:41:07.253099       1 request.go:655] Throttling request took 1.048474623s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
	W0414 11:41:08.104464       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0414 11:41:29.800429       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0414 11:41:39.754800       1 request.go:655] Throttling request took 1.048395991s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0414 11:41:40.606603       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0414 11:42:00.306507       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0414 11:42:12.256984       1 request.go:655] Throttling request took 1.048481579s, request: GET:https://192.168.76.2:8443/apis/rbac.authorization.k8s.io/v1beta1?timeout=32s
	W0414 11:42:13.108452       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0414 11:42:30.808188       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0414 11:42:44.758875       1 request.go:655] Throttling request took 1.048291066s, request: GET:https://192.168.76.2:8443/apis/autoscaling/v1?timeout=32s
	W0414 11:42:45.610319       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0414 11:43:01.310043       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0414 11:43:17.213159       1 request.go:655] Throttling request took 1.000881234s, request: GET:https://192.168.76.2:8443/apis/networking.k8s.io/v1beta1?timeout=32s
	W0414 11:43:18.113474       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0414 11:43:31.811946       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0414 11:43:49.763928       1 request.go:655] Throttling request took 1.04839686s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0414 11:43:50.615288       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0414 11:44:02.314160       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0414 11:44:22.265871       1 request.go:655] Throttling request took 1.04824586s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0414 11:44:23.117351       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0414 11:44:32.829581       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0414 11:44:54.767740       1 request.go:655] Throttling request took 1.04810435s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0414 11:44:55.619590       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	
	
	==> kube-controller-manager [d980a0c3a521acf80d9d000b62e5487a6e2a9cca9211cf9ce1cf98291bd483a6] <==
	I0414 11:36:45.191909       1 shared_informer.go:247] Caches are synced for disruption 
	I0414 11:36:45.191943       1 disruption.go:339] Sending events to api server.
	I0414 11:36:45.192033       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
	I0414 11:36:45.203698       1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-rhrdw"
	I0414 11:36:45.231005       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-b6hq8"
	I0414 11:36:45.236225       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-fv898"
	I0414 11:36:45.245842       1 shared_informer.go:247] Caches are synced for endpoint 
	I0414 11:36:45.246099       1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring 
	I0414 11:36:45.269485       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-cx4np"
	I0414 11:36:45.294841       1 shared_informer.go:247] Caches are synced for attach detach 
	I0414 11:36:45.393930       1 shared_informer.go:247] Caches are synced for resource quota 
	I0414 11:36:45.480597       1 shared_informer.go:240] Waiting for caches to sync for garbage collector
	I0414 11:36:45.740936       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0414 11:36:45.740966       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0414 11:36:45.780826       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0414 11:36:46.140839       1 request.go:655] Throttling request took 1.041100394s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	I0414 11:36:46.721534       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
	I0414 11:36:46.773073       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-cx4np"
	I0414 11:36:46.942717       1 shared_informer.go:240] Waiting for caches to sync for resource quota
	I0414 11:36:46.942751       1 shared_informer.go:247] Caches are synced for resource quota 
	I0414 11:36:50.122559       1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
	I0414 11:38:30.306637       1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
	E0414 11:38:30.580031       1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
	E0414 11:38:30.581252       1 clusterroleaggregation_controller.go:181] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
	I0414 11:38:31.413509       1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: metrics-server-9975d5f86-7rqxd"
	
	
	==> kube-proxy [13c73f9eba6698d2af640373e7b8e39d52d664ecacdd0456aed1e6a9d8b225d1] <==
	I0414 11:36:46.181660       1 node.go:172] Successfully retrieved node IP: 192.168.76.2
	I0414 11:36:46.181821       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
	W0414 11:36:46.245624       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
	I0414 11:36:46.245823       1 server_others.go:185] Using iptables Proxier.
	I0414 11:36:46.246123       1 server.go:650] Version: v1.20.0
	I0414 11:36:46.250510       1 config.go:315] Starting service config controller
	I0414 11:36:46.257685       1 shared_informer.go:240] Waiting for caches to sync for service config
	I0414 11:36:46.257702       1 shared_informer.go:247] Caches are synced for service config 
	I0414 11:36:46.255038       1 config.go:224] Starting endpoint slice config controller
	I0414 11:36:46.258025       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	I0414 11:36:46.358163       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	
	
	==> kube-proxy [79c9b42c48cf90141ff668b53f7e9b07e00d01eb9ccb093d04eb9a7bb095e803] <==
	I0414 11:39:12.290033       1 node.go:172] Successfully retrieved node IP: 192.168.76.2
	I0414 11:39:12.290298       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
	W0414 11:39:12.323112       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
	I0414 11:39:12.323233       1 server_others.go:185] Using iptables Proxier.
	I0414 11:39:12.323480       1 server.go:650] Version: v1.20.0
	I0414 11:39:12.323905       1 config.go:315] Starting service config controller
	I0414 11:39:12.323913       1 shared_informer.go:240] Waiting for caches to sync for service config
	I0414 11:39:12.323927       1 config.go:224] Starting endpoint slice config controller
	I0414 11:39:12.323931       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	I0414 11:39:12.424152       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	I0414 11:39:12.429863       1 shared_informer.go:247] Caches are synced for service config 
	
	
	==> kube-scheduler [1fccd9ab2f416209ffcb46fc280b9a5e065078b5eec940eccdfb5e454e965d6e] <==
	I0414 11:39:04.649206       1 serving.go:331] Generated self-signed cert in-memory
	W0414 11:39:09.682695       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W0414 11:39:09.682733       1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W0414 11:39:09.682743       1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0414 11:39:09.682749       1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0414 11:39:09.993531       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
	I0414 11:39:09.993688       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0414 11:39:09.993699       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0414 11:39:09.993711       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	I0414 11:39:10.097985       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	
	==> kube-scheduler [f0cc66fe654dbe9a48354054e5e18a5e24e2abf9fb2fe2d59d6468869ca5d993] <==
	I0414 11:36:22.680904       1 serving.go:331] Generated self-signed cert in-memory
	W0414 11:36:26.405731       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W0414 11:36:26.405839       1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W0414 11:36:26.405876       1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0414 11:36:26.405903       1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0414 11:36:26.505864       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0414 11:36:26.505966       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0414 11:36:26.506227       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
	I0414 11:36:26.506303       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	E0414 11:36:26.518337       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0414 11:36:26.518557       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0414 11:36:26.530361       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0414 11:36:26.537032       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0414 11:36:26.542995       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0414 11:36:26.543831       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0414 11:36:26.545058       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0414 11:36:26.545243       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0414 11:36:26.545314       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0414 11:36:26.545365       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0414 11:36:26.545472       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0414 11:36:26.543157       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	I0414 11:36:27.906115       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	
	==> kubelet <==
	Apr 14 11:43:39 old-k8s-version-943255 kubelet[661]: I0414 11:43:39.191479     661 scope.go:95] [topologymanager] RemoveContainer - Container ID: d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46
	Apr 14 11:43:39 old-k8s-version-943255 kubelet[661]: E0414 11:43:39.191923     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	Apr 14 11:43:48 old-k8s-version-943255 kubelet[661]: E0414 11:43:48.192882     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Apr 14 11:43:54 old-k8s-version-943255 kubelet[661]: I0414 11:43:54.191621     661 scope.go:95] [topologymanager] RemoveContainer - Container ID: d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46
	Apr 14 11:43:54 old-k8s-version-943255 kubelet[661]: E0414 11:43:54.192005     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	Apr 14 11:43:59 old-k8s-version-943255 kubelet[661]: E0414 11:43:59.193181     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Apr 14 11:44:05 old-k8s-version-943255 kubelet[661]: I0414 11:44:05.191536     661 scope.go:95] [topologymanager] RemoveContainer - Container ID: d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46
	Apr 14 11:44:05 old-k8s-version-943255 kubelet[661]: E0414 11:44:05.192322     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	Apr 14 11:44:11 old-k8s-version-943255 kubelet[661]: E0414 11:44:11.192365     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Apr 14 11:44:16 old-k8s-version-943255 kubelet[661]: I0414 11:44:16.191631     661 scope.go:95] [topologymanager] RemoveContainer - Container ID: d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46
	Apr 14 11:44:16 old-k8s-version-943255 kubelet[661]: E0414 11:44:16.192478     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	Apr 14 11:44:23 old-k8s-version-943255 kubelet[661]: E0414 11:44:23.192167     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Apr 14 11:44:29 old-k8s-version-943255 kubelet[661]: I0414 11:44:29.193211     661 scope.go:95] [topologymanager] RemoveContainer - Container ID: d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46
	Apr 14 11:44:29 old-k8s-version-943255 kubelet[661]: E0414 11:44:29.194021     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	Apr 14 11:44:37 old-k8s-version-943255 kubelet[661]: E0414 11:44:37.193029     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Apr 14 11:44:41 old-k8s-version-943255 kubelet[661]: I0414 11:44:41.191471     661 scope.go:95] [topologymanager] RemoveContainer - Container ID: d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46
	Apr 14 11:44:41 old-k8s-version-943255 kubelet[661]: E0414 11:44:41.192234     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	Apr 14 11:44:49 old-k8s-version-943255 kubelet[661]: E0414 11:44:49.218471     661 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
	Apr 14 11:44:49 old-k8s-version-943255 kubelet[661]: E0414 11:44:49.218908     661 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
	Apr 14 11:44:49 old-k8s-version-943255 kubelet[661]: E0414 11:44:49.219478     661 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>}  BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-9hmzl,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-7rqxd_kube-system(71fc092
3-7b65-4b09-a48f-0a3c71066699): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
	Apr 14 11:44:49 old-k8s-version-943255 kubelet[661]: E0414 11:44:49.219674     661 pod_workers.go:191] Error syncing pod 71fc0923-7b65-4b09-a48f-0a3c71066699 ("metrics-server-9975d5f86-7rqxd_kube-system(71fc0923-7b65-4b09-a48f-0a3c71066699)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	Apr 14 11:44:56 old-k8s-version-943255 kubelet[661]: I0414 11:44:56.191479     661 scope.go:95] [topologymanager] RemoveContainer - Container ID: d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46
	Apr 14 11:44:56 old-k8s-version-943255 kubelet[661]: I0414 11:44:56.535868     661 scope.go:95] [topologymanager] RemoveContainer - Container ID: d6d49024b726da144f3869b130023bed07ed052c7c182852a0ee2efa6c793d46
	Apr 14 11:44:56 old-k8s-version-943255 kubelet[661]: I0414 11:44:56.536234     661 scope.go:95] [topologymanager] RemoveContainer - Container ID: f3fe1f3572c032d372784638fc602d8ef649f2ab7feefa7bf203c9122260a145
	Apr 14 11:44:56 old-k8s-version-943255 kubelet[661]: E0414 11:44:56.536520     661 pod_workers.go:191] Error syncing pod 8099402f-99d6-49b6-8298-f919ba25dd03 ("dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 5m0s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-jpjgb_kubernetes-dashboard(8099402f-99d6-49b6-8298-f919ba25dd03)"
	
	
	==> kubernetes-dashboard [59b5daad610a953bdfa365e57443632131e315380f3932f1e70fc6821886a566] <==
	2025/04/14 11:39:35 Using namespace: kubernetes-dashboard
	2025/04/14 11:39:35 Using in-cluster config to connect to apiserver
	2025/04/14 11:39:35 Using secret token for csrf signing
	2025/04/14 11:39:35 Initializing csrf token from kubernetes-dashboard-csrf secret
	2025/04/14 11:39:35 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
	2025/04/14 11:39:35 Successful initial request to the apiserver, version: v1.20.0
	2025/04/14 11:39:35 Generating JWE encryption key
	2025/04/14 11:39:35 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
	2025/04/14 11:39:35 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
	2025/04/14 11:39:36 Initializing JWE encryption key from synchronized object
	2025/04/14 11:39:36 Creating in-cluster Sidecar client
	2025/04/14 11:39:36 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2025/04/14 11:39:36 Serving insecurely on HTTP port: 9090
	2025/04/14 11:40:06 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2025/04/14 11:40:36 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2025/04/14 11:41:06 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2025/04/14 11:41:36 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2025/04/14 11:42:06 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2025/04/14 11:42:36 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2025/04/14 11:43:06 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2025/04/14 11:43:36 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2025/04/14 11:44:06 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2025/04/14 11:44:36 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2025/04/14 11:39:35 Starting overwatch
	
	
	==> storage-provisioner [daf4175e5b7abdd9b6fc24d967616abee8e58d39811a21b110b4ed1c20dcdbd9] <==
	I0414 11:39:11.860848       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	F0414 11:39:41.863147       1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
	
	
	==> storage-provisioner [e91667bb9e4d3a4a67ee3b7d7f830b9bbced4428dc545e292333a361a41354aa] <==
	I0414 11:39:56.385970       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0414 11:39:56.429994       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0414 11:39:56.430256       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0414 11:40:13.911900       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0414 11:40:13.912429       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"d16a269a-4a17-4241-b129-fe6922ff43b1", APIVersion:"v1", ResourceVersion:"844", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-943255_b4263a48-4a5c-4021-a34a-33f437092d5f became leader
	I0414 11:40:13.912592       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-943255_b4263a48-4a5c-4021-a34a-33f437092d5f!
	I0414 11:40:14.013440       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-943255_b4263a48-4a5c-4021-a34a-33f437092d5f!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-943255 -n old-k8s-version-943255
helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-943255 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-7rqxd
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context old-k8s-version-943255 describe pod metrics-server-9975d5f86-7rqxd
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-943255 describe pod metrics-server-9975d5f86-7rqxd: exit status 1 (110.553059ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "metrics-server-9975d5f86-7rqxd" not found

                                                
                                                
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-943255 describe pod metrics-server-9975d5f86-7rqxd: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (380.89s)

                                                
                                    

Test pass (300/331)

Order passed test Duration
3 TestDownloadOnly/v1.20.0/json-events 11.93
4 TestDownloadOnly/v1.20.0/preload-exists 0
8 TestDownloadOnly/v1.20.0/LogsDuration 0.09
9 TestDownloadOnly/v1.20.0/DeleteAll 0.2
10 TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds 0.13
12 TestDownloadOnly/v1.32.2/json-events 6.81
13 TestDownloadOnly/v1.32.2/preload-exists 0
17 TestDownloadOnly/v1.32.2/LogsDuration 0.08
18 TestDownloadOnly/v1.32.2/DeleteAll 0.2
19 TestDownloadOnly/v1.32.2/DeleteAlwaysSucceeds 0.13
21 TestBinaryMirror 0.59
25 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.07
26 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.07
27 TestAddons/Setup 216.53
29 TestAddons/serial/Volcano 39.98
31 TestAddons/serial/GCPAuth/Namespaces 0.18
32 TestAddons/serial/GCPAuth/FakeCredentials 9.87
35 TestAddons/parallel/Registry 14.57
36 TestAddons/parallel/Ingress 19.69
37 TestAddons/parallel/InspektorGadget 11.75
38 TestAddons/parallel/MetricsServer 5.75
40 TestAddons/parallel/CSI 34.19
41 TestAddons/parallel/Headlamp 16.77
42 TestAddons/parallel/CloudSpanner 5.59
43 TestAddons/parallel/LocalPath 51.52
44 TestAddons/parallel/NvidiaDevicePlugin 6.64
45 TestAddons/parallel/Yakd 11.82
47 TestAddons/StoppedEnableDisable 12.25
48 TestCertOptions 32.77
49 TestCertExpiration 228.43
51 TestForceSystemdFlag 38.91
52 TestForceSystemdEnv 39.12
53 TestDockerEnvContainerd 47.21
58 TestErrorSpam/setup 28.77
59 TestErrorSpam/start 0.74
60 TestErrorSpam/status 1.09
61 TestErrorSpam/pause 1.73
62 TestErrorSpam/unpause 1.76
63 TestErrorSpam/stop 1.43
66 TestFunctional/serial/CopySyncFile 0
67 TestFunctional/serial/StartWithProxy 45.44
68 TestFunctional/serial/AuditLog 0
69 TestFunctional/serial/SoftStart 6.02
70 TestFunctional/serial/KubeContext 0.06
71 TestFunctional/serial/KubectlGetPods 0.09
74 TestFunctional/serial/CacheCmd/cache/add_remote 3.93
75 TestFunctional/serial/CacheCmd/cache/add_local 1.22
76 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.05
77 TestFunctional/serial/CacheCmd/cache/list 0.06
78 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.28
79 TestFunctional/serial/CacheCmd/cache/cache_reload 2.03
80 TestFunctional/serial/CacheCmd/cache/delete 0.11
81 TestFunctional/serial/MinikubeKubectlCmd 0.14
82 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.13
83 TestFunctional/serial/ExtraConfig 58.92
84 TestFunctional/serial/ComponentHealth 0.09
85 TestFunctional/serial/LogsCmd 1.69
86 TestFunctional/serial/LogsFileCmd 1.71
87 TestFunctional/serial/InvalidService 4.89
89 TestFunctional/parallel/ConfigCmd 0.46
90 TestFunctional/parallel/DashboardCmd 11.25
91 TestFunctional/parallel/DryRun 0.42
92 TestFunctional/parallel/InternationalLanguage 0.28
93 TestFunctional/parallel/StatusCmd 0.97
97 TestFunctional/parallel/ServiceCmdConnect 9.69
98 TestFunctional/parallel/AddonsCmd 0.2
99 TestFunctional/parallel/PersistentVolumeClaim 25.14
101 TestFunctional/parallel/SSHCmd 0.7
102 TestFunctional/parallel/CpCmd 2.24
104 TestFunctional/parallel/FileSync 0.38
105 TestFunctional/parallel/CertSync 2.08
109 TestFunctional/parallel/NodeLabels 0.11
111 TestFunctional/parallel/NonActiveRuntimeDisabled 0.64
113 TestFunctional/parallel/License 0.24
115 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.61
116 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
118 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 9.44
119 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.1
120 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
124 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
125 TestFunctional/parallel/ServiceCmd/DeployApp 8.2
126 TestFunctional/parallel/ProfileCmd/profile_not_create 0.42
127 TestFunctional/parallel/ProfileCmd/profile_list 0.41
128 TestFunctional/parallel/ProfileCmd/profile_json_output 0.4
129 TestFunctional/parallel/MountCmd/any-port 7.09
130 TestFunctional/parallel/ServiceCmd/List 0.57
131 TestFunctional/parallel/ServiceCmd/JSONOutput 0.55
132 TestFunctional/parallel/ServiceCmd/HTTPS 0.37
133 TestFunctional/parallel/ServiceCmd/Format 0.36
134 TestFunctional/parallel/ServiceCmd/URL 0.36
135 TestFunctional/parallel/MountCmd/specific-port 2.15
136 TestFunctional/parallel/MountCmd/VerifyCleanup 1.81
137 TestFunctional/parallel/Version/short 0.06
138 TestFunctional/parallel/Version/components 1.39
139 TestFunctional/parallel/ImageCommands/ImageListShort 0.24
140 TestFunctional/parallel/ImageCommands/ImageListTable 0.27
141 TestFunctional/parallel/ImageCommands/ImageListJson 0.28
142 TestFunctional/parallel/ImageCommands/ImageListYaml 0.23
143 TestFunctional/parallel/ImageCommands/ImageBuild 3.87
144 TestFunctional/parallel/ImageCommands/Setup 0.72
145 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 1.15
146 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 1.07
147 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 1.41
148 TestFunctional/parallel/UpdateContextCmd/no_changes 0.21
149 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.17
150 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.16
151 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.43
152 TestFunctional/parallel/ImageCommands/ImageRemove 0.62
153 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.87
154 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.51
155 TestFunctional/delete_echo-server_images 0.04
156 TestFunctional/delete_my-image_image 0.02
157 TestFunctional/delete_minikube_cached_images 0.02
162 TestMultiControlPlane/serial/StartCluster 121.96
163 TestMultiControlPlane/serial/DeployApp 31.49
164 TestMultiControlPlane/serial/PingHostFromPods 1.59
165 TestMultiControlPlane/serial/AddWorkerNode 24.02
166 TestMultiControlPlane/serial/NodeLabels 0.1
167 TestMultiControlPlane/serial/HAppyAfterClusterStart 0.94
168 TestMultiControlPlane/serial/CopyFile 18.26
169 TestMultiControlPlane/serial/StopSecondaryNode 12.7
170 TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop 0.75
171 TestMultiControlPlane/serial/RestartSecondaryNode 18.92
172 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart 1
173 TestMultiControlPlane/serial/RestartClusterKeepsNodes 134.03
174 TestMultiControlPlane/serial/DeleteSecondaryNode 10.4
175 TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete 0.74
176 TestMultiControlPlane/serial/StopCluster 35.84
177 TestMultiControlPlane/serial/RestartCluster 74.3
178 TestMultiControlPlane/serial/DegradedAfterClusterRestart 0.73
179 TestMultiControlPlane/serial/AddSecondaryNode 40.45
180 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd 0.98
184 TestJSONOutput/start/Command 59.09
185 TestJSONOutput/start/Audit 0
187 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
188 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
190 TestJSONOutput/pause/Command 0.76
191 TestJSONOutput/pause/Audit 0
193 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
194 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
196 TestJSONOutput/unpause/Command 0.62
197 TestJSONOutput/unpause/Audit 0
199 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
200 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
202 TestJSONOutput/stop/Command 5.74
203 TestJSONOutput/stop/Audit 0
205 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
206 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
207 TestErrorJSONOutput 0.24
209 TestKicCustomNetwork/create_custom_network 39.45
210 TestKicCustomNetwork/use_default_bridge_network 33.53
211 TestKicExistingNetwork 33.36
212 TestKicCustomSubnet 34.63
213 TestKicStaticIP 32.96
214 TestMainNoArgs 0.06
215 TestMinikubeProfile 67.08
218 TestMountStart/serial/StartWithMountFirst 8.63
219 TestMountStart/serial/VerifyMountFirst 0.24
220 TestMountStart/serial/StartWithMountSecond 8.73
221 TestMountStart/serial/VerifyMountSecond 0.26
222 TestMountStart/serial/DeleteFirst 1.6
223 TestMountStart/serial/VerifyMountPostDelete 0.25
224 TestMountStart/serial/Stop 1.19
225 TestMountStart/serial/RestartStopped 7.12
226 TestMountStart/serial/VerifyMountPostStop 0.26
229 TestMultiNode/serial/FreshStart2Nodes 75.21
230 TestMultiNode/serial/DeployApp2Nodes 15.97
231 TestMultiNode/serial/PingHostFrom2Pods 1.03
232 TestMultiNode/serial/AddNode 19.71
233 TestMultiNode/serial/MultiNodeLabels 0.09
234 TestMultiNode/serial/ProfileList 0.67
235 TestMultiNode/serial/CopyFile 9.57
236 TestMultiNode/serial/StopNode 2.17
237 TestMultiNode/serial/StartAfterStop 9.51
238 TestMultiNode/serial/RestartKeepsNodes 80.17
239 TestMultiNode/serial/DeleteNode 5.26
240 TestMultiNode/serial/StopMultiNode 23.88
241 TestMultiNode/serial/RestartMultiNode 50.95
242 TestMultiNode/serial/ValidateNameConflict 30.04
247 TestPreload 122.64
249 TestScheduledStopUnix 108.07
252 TestInsufficientStorage 10.5
253 TestRunningBinaryUpgrade 84.78
255 TestKubernetesUpgrade 105.43
256 TestMissingContainerUpgrade 181.48
258 TestPause/serial/Start 55.07
259 TestPause/serial/SecondStartNoReconfiguration 7.16
260 TestPause/serial/Pause 0.7
261 TestPause/serial/VerifyStatus 0.32
262 TestPause/serial/Unpause 0.65
263 TestPause/serial/PauseAgain 0.81
264 TestPause/serial/DeletePaused 2.51
265 TestPause/serial/VerifyDeletedResources 0.38
266 TestStoppedBinaryUpgrade/Setup 1
267 TestStoppedBinaryUpgrade/Upgrade 173.89
276 TestNoKubernetes/serial/StartNoK8sWithVersion 0.09
277 TestNoKubernetes/serial/StartWithK8s 34
278 TestNoKubernetes/serial/StartWithStopK8s 16.83
279 TestStoppedBinaryUpgrade/MinikubeLogs 1.09
287 TestNetworkPlugins/group/false 5.33
288 TestNoKubernetes/serial/Start 7.73
292 TestNoKubernetes/serial/VerifyK8sNotRunning 0.33
293 TestNoKubernetes/serial/ProfileList 0.8
294 TestNoKubernetes/serial/Stop 1.26
295 TestNoKubernetes/serial/StartNoArgs 6.87
296 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.53
298 TestStartStop/group/old-k8s-version/serial/FirstStart 157.14
300 TestStartStop/group/no-preload/serial/FirstStart 75.8
301 TestStartStop/group/old-k8s-version/serial/DeployApp 8.85
302 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 2.08
303 TestStartStop/group/old-k8s-version/serial/Stop 12.4
304 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.23
306 TestStartStop/group/no-preload/serial/DeployApp 9.39
307 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 1.38
308 TestStartStop/group/no-preload/serial/Stop 11.98
309 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.19
310 TestStartStop/group/no-preload/serial/SecondStart 266
311 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 6
312 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.12
313 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.25
314 TestStartStop/group/no-preload/serial/Pause 3.07
316 TestStartStop/group/embed-certs/serial/FirstStart 52.16
317 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 6.01
318 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.1
319 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.24
320 TestStartStop/group/old-k8s-version/serial/Pause 2.89
322 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 68.65
323 TestStartStop/group/embed-certs/serial/DeployApp 9.42
324 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 1.63
325 TestStartStop/group/embed-certs/serial/Stop 12.31
326 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.35
327 TestStartStop/group/embed-certs/serial/SecondStart 292.43
328 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 10.43
329 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 1.25
330 TestStartStop/group/default-k8s-diff-port/serial/Stop 12.11
331 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.2
332 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 268.79
333 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 6.01
334 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.1
335 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.24
336 TestStartStop/group/embed-certs/serial/Pause 3.22
338 TestStartStop/group/newest-cni/serial/FirstStart 37.23
339 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 6
340 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 6.15
341 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.45
342 TestStartStop/group/newest-cni/serial/DeployApp 0
343 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 1.5
344 TestStartStop/group/default-k8s-diff-port/serial/Pause 4.27
345 TestStartStop/group/newest-cni/serial/Stop 1.35
346 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.27
347 TestStartStop/group/newest-cni/serial/SecondStart 20.52
348 TestNetworkPlugins/group/auto/Start 64.1
349 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
350 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
351 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.25
352 TestStartStop/group/newest-cni/serial/Pause 4.03
353 TestNetworkPlugins/group/kindnet/Start 58.25
354 TestNetworkPlugins/group/auto/KubeletFlags 0.4
355 TestNetworkPlugins/group/auto/NetCatPod 9.38
356 TestNetworkPlugins/group/auto/DNS 0.19
357 TestNetworkPlugins/group/auto/Localhost 0.14
358 TestNetworkPlugins/group/auto/HairPin 0.18
359 TestNetworkPlugins/group/kindnet/ControllerPod 6
360 TestNetworkPlugins/group/kindnet/KubeletFlags 0.33
361 TestNetworkPlugins/group/kindnet/NetCatPod 9.4
362 TestNetworkPlugins/group/calico/Start 74.67
363 TestNetworkPlugins/group/kindnet/DNS 0.2
364 TestNetworkPlugins/group/kindnet/Localhost 0.23
365 TestNetworkPlugins/group/kindnet/HairPin 0.22
366 TestNetworkPlugins/group/custom-flannel/Start 58.05
367 TestNetworkPlugins/group/calico/ControllerPod 6.01
368 TestNetworkPlugins/group/calico/KubeletFlags 0.29
369 TestNetworkPlugins/group/calico/NetCatPod 11.3
370 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.36
371 TestNetworkPlugins/group/custom-flannel/NetCatPod 10.34
372 TestNetworkPlugins/group/calico/DNS 0.24
373 TestNetworkPlugins/group/calico/Localhost 0.16
374 TestNetworkPlugins/group/calico/HairPin 0.16
375 TestNetworkPlugins/group/custom-flannel/DNS 0.19
376 TestNetworkPlugins/group/custom-flannel/Localhost 0.16
377 TestNetworkPlugins/group/custom-flannel/HairPin 0.22
378 TestNetworkPlugins/group/enable-default-cni/Start 77.27
379 TestNetworkPlugins/group/flannel/Start 56.6
380 TestNetworkPlugins/group/flannel/ControllerPod 6.01
381 TestNetworkPlugins/group/flannel/KubeletFlags 0.29
382 TestNetworkPlugins/group/flannel/NetCatPod 9.26
383 TestNetworkPlugins/group/flannel/DNS 0.2
384 TestNetworkPlugins/group/flannel/Localhost 0.17
385 TestNetworkPlugins/group/flannel/HairPin 0.17
386 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.28
387 TestNetworkPlugins/group/enable-default-cni/NetCatPod 9.28
388 TestNetworkPlugins/group/enable-default-cni/DNS 0.27
389 TestNetworkPlugins/group/enable-default-cni/Localhost 0.26
390 TestNetworkPlugins/group/enable-default-cni/HairPin 0.2
391 TestNetworkPlugins/group/bridge/Start 49.28
392 TestNetworkPlugins/group/bridge/KubeletFlags 0.27
393 TestNetworkPlugins/group/bridge/NetCatPod 10.29
394 TestNetworkPlugins/group/bridge/DNS 0.16
395 TestNetworkPlugins/group/bridge/Localhost 0.15
396 TestNetworkPlugins/group/bridge/HairPin 0.16
x
+
TestDownloadOnly/v1.20.0/json-events (11.93s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-950535 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-950535 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (11.931126683s)
--- PASS: TestDownloadOnly/v1.20.0/json-events (11.93s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/preload-exists
I0414 10:53:00.270508  600227 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
I0414 10:53:00.270589  600227 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20534-594855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
--- PASS: TestDownloadOnly/v1.20.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/LogsDuration (0.09s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-950535
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-950535: exit status 85 (88.211958ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-950535 | jenkins | v1.35.0 | 14 Apr 25 10:52 UTC |          |
	|         | -p download-only-950535        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	
	==> Last Start <==
	Log file created at: 2025/04/14 10:52:48
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.24.0 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0414 10:52:48.384676  600233 out.go:345] Setting OutFile to fd 1 ...
	I0414 10:52:48.384795  600233 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 10:52:48.384806  600233 out.go:358] Setting ErrFile to fd 2...
	I0414 10:52:48.384811  600233 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 10:52:48.385058  600233 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
	W0414 10:52:48.385188  600233 root.go:314] Error reading config file at /home/jenkins/minikube-integration/20534-594855/.minikube/config/config.json: open /home/jenkins/minikube-integration/20534-594855/.minikube/config/config.json: no such file or directory
	I0414 10:52:48.385576  600233 out.go:352] Setting JSON to true
	I0414 10:52:48.386448  600233 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":9314,"bootTime":1744618655,"procs":154,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1081-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0414 10:52:48.386510  600233 start.go:139] virtualization:  
	I0414 10:52:48.390664  600233 out.go:97] [download-only-950535] minikube v1.35.0 on Ubuntu 20.04 (arm64)
	W0414 10:52:48.390815  600233 preload.go:293] Failed to list preload files: open /home/jenkins/minikube-integration/20534-594855/.minikube/cache/preloaded-tarball: no such file or directory
	I0414 10:52:48.390920  600233 notify.go:220] Checking for updates...
	I0414 10:52:48.393767  600233 out.go:169] MINIKUBE_LOCATION=20534
	I0414 10:52:48.396624  600233 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0414 10:52:48.399491  600233 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig
	I0414 10:52:48.402364  600233 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube
	I0414 10:52:48.405136  600233 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0414 10:52:48.410647  600233 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0414 10:52:48.410874  600233 driver.go:394] Setting default libvirt URI to qemu:///system
	I0414 10:52:48.430912  600233 docker.go:123] docker version: linux-28.0.4:Docker Engine - Community
	I0414 10:52:48.431010  600233 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0414 10:52:48.487721  600233 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:28 OomKillDisable:true NGoroutines:53 SystemTime:2025-04-14 10:52:48.478936457 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1081-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0]] Warnings:<nil>}}
	I0414 10:52:48.487827  600233 docker.go:318] overlay module found
	I0414 10:52:48.490887  600233 out.go:97] Using the docker driver based on user configuration
	I0414 10:52:48.490916  600233 start.go:297] selected driver: docker
	I0414 10:52:48.490927  600233 start.go:901] validating driver "docker" against <nil>
	I0414 10:52:48.491026  600233 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0414 10:52:48.541068  600233 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:28 OomKillDisable:true NGoroutines:53 SystemTime:2025-04-14 10:52:48.532062641 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1081-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0]] Warnings:<nil>}}
	I0414 10:52:48.541224  600233 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0414 10:52:48.541504  600233 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0414 10:52:48.541665  600233 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0414 10:52:48.544788  600233 out.go:169] Using Docker driver with root privileges
	I0414 10:52:48.547668  600233 cni.go:84] Creating CNI manager for ""
	I0414 10:52:48.547729  600233 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0414 10:52:48.547743  600233 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0414 10:52:48.547816  600233 start.go:340] cluster config:
	{Name:download-only-950535 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-950535 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0414 10:52:48.550676  600233 out.go:97] Starting "download-only-950535" primary control-plane node in "download-only-950535" cluster
	I0414 10:52:48.550696  600233 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0414 10:52:48.553456  600233 out.go:97] Pulling base image v0.0.46-1744107393-20604 ...
	I0414 10:52:48.553481  600233 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0414 10:52:48.553633  600233 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a in local docker daemon
	I0414 10:52:48.568855  600233 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a to local cache
	I0414 10:52:48.569037  600233 image.go:65] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a in local cache directory
	I0414 10:52:48.569133  600233 image.go:150] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a to local cache
	I0414 10:52:48.613302  600233 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
	I0414 10:52:48.613338  600233 cache.go:56] Caching tarball of preloaded images
	I0414 10:52:48.613966  600233 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0414 10:52:48.617363  600233 out.go:97] Downloading Kubernetes v1.20.0 preload ...
	I0414 10:52:48.617386  600233 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 ...
	I0414 10:52:48.704105  600233 download.go:108] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4?checksum=md5:7e3d48ccb9f143791669d02e14ce1643 -> /home/jenkins/minikube-integration/20534-594855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
	I0414 10:52:57.393655  600233 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 ...
	I0414 10:52:57.393753  600233 preload.go:254] verifying checksum of /home/jenkins/minikube-integration/20534-594855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 ...
	
	
	* The control-plane node download-only-950535 host does not exist
	  To start a cluster, run: "minikube start -p download-only-950535"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.20.0/LogsDuration (0.09s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAll (0.2s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.20.0/DeleteAll (0.20s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-950535
--- PASS: TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                    
x
+
TestDownloadOnly/v1.32.2/json-events (6.81s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.32.2/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-553625 --force --alsologtostderr --kubernetes-version=v1.32.2 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-553625 --force --alsologtostderr --kubernetes-version=v1.32.2 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (6.813092012s)
--- PASS: TestDownloadOnly/v1.32.2/json-events (6.81s)

                                                
                                    
x
+
TestDownloadOnly/v1.32.2/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.32.2/preload-exists
I0414 10:53:07.501975  600227 preload.go:131] Checking if preload exists for k8s version v1.32.2 and runtime containerd
I0414 10:53:07.502010  600227 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20534-594855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-containerd-overlay2-arm64.tar.lz4
--- PASS: TestDownloadOnly/v1.32.2/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.32.2/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.32.2/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-553625
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-553625: exit status 85 (83.152781ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-950535 | jenkins | v1.35.0 | 14 Apr 25 10:52 UTC |                     |
	|         | -p download-only-950535        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	| delete  | --all                          | minikube             | jenkins | v1.35.0 | 14 Apr 25 10:53 UTC | 14 Apr 25 10:53 UTC |
	| delete  | -p download-only-950535        | download-only-950535 | jenkins | v1.35.0 | 14 Apr 25 10:53 UTC | 14 Apr 25 10:53 UTC |
	| start   | -o=json --download-only        | download-only-553625 | jenkins | v1.35.0 | 14 Apr 25 10:53 UTC |                     |
	|         | -p download-only-553625        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.32.2   |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2025/04/14 10:53:00
	Running on machine: ip-172-31-21-244
	Binary: Built with gc go1.24.0 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0414 10:53:00.735395  600430 out.go:345] Setting OutFile to fd 1 ...
	I0414 10:53:00.735529  600430 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 10:53:00.735538  600430 out.go:358] Setting ErrFile to fd 2...
	I0414 10:53:00.735543  600430 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 10:53:00.735790  600430 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
	I0414 10:53:00.736186  600430 out.go:352] Setting JSON to true
	I0414 10:53:00.736991  600430 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":9326,"bootTime":1744618655,"procs":152,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1081-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0414 10:53:00.737054  600430 start.go:139] virtualization:  
	I0414 10:53:00.740361  600430 out.go:97] [download-only-553625] minikube v1.35.0 on Ubuntu 20.04 (arm64)
	I0414 10:53:00.740595  600430 notify.go:220] Checking for updates...
	I0414 10:53:00.743455  600430 out.go:169] MINIKUBE_LOCATION=20534
	I0414 10:53:00.746811  600430 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0414 10:53:00.749821  600430 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig
	I0414 10:53:00.752706  600430 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube
	I0414 10:53:00.755478  600430 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0414 10:53:00.761036  600430 out.go:321] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0414 10:53:00.761280  600430 driver.go:394] Setting default libvirt URI to qemu:///system
	I0414 10:53:00.785449  600430 docker.go:123] docker version: linux-28.0.4:Docker Engine - Community
	I0414 10:53:00.785566  600430 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0414 10:53:00.840427  600430 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:27 OomKillDisable:true NGoroutines:43 SystemTime:2025-04-14 10:53:00.831816389 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1081-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0]] Warnings:<nil>}}
	I0414 10:53:00.840539  600430 docker.go:318] overlay module found
	I0414 10:53:00.843477  600430 out.go:97] Using the docker driver based on user configuration
	I0414 10:53:00.843514  600430 start.go:297] selected driver: docker
	I0414 10:53:00.843524  600430 start.go:901] validating driver "docker" against <nil>
	I0414 10:53:00.843632  600430 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0414 10:53:00.893661  600430 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:27 OomKillDisable:true NGoroutines:43 SystemTime:2025-04-14 10:53:00.885039944 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1081-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0]] Warnings:<nil>}}
	I0414 10:53:00.893835  600430 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0414 10:53:00.894123  600430 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0414 10:53:00.894321  600430 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0414 10:53:00.897514  600430 out.go:169] Using Docker driver with root privileges
	I0414 10:53:00.900288  600430 cni.go:84] Creating CNI manager for ""
	I0414 10:53:00.900341  600430 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0414 10:53:00.900354  600430 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0414 10:53:00.900427  600430 start.go:340] cluster config:
	{Name:download-only-553625 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:download-only-553625 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0414 10:53:00.903312  600430 out.go:97] Starting "download-only-553625" primary control-plane node in "download-only-553625" cluster
	I0414 10:53:00.903333  600430 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0414 10:53:00.906090  600430 out.go:97] Pulling base image v0.0.46-1744107393-20604 ...
	I0414 10:53:00.906120  600430 preload.go:131] Checking if preload exists for k8s version v1.32.2 and runtime containerd
	I0414 10:53:00.906292  600430 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a in local docker daemon
	I0414 10:53:00.921384  600430 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a to local cache
	I0414 10:53:00.921526  600430 image.go:65] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a in local cache directory
	I0414 10:53:00.921548  600430 image.go:68] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a in local cache directory, skipping pull
	I0414 10:53:00.921558  600430 image.go:137] gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a exists in cache, skipping pull
	I0414 10:53:00.921567  600430 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a as a tarball
	I0414 10:53:00.963491  600430 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.32.2/preloaded-images-k8s-v18-v1.32.2-containerd-overlay2-arm64.tar.lz4
	I0414 10:53:00.963516  600430 cache.go:56] Caching tarball of preloaded images
	I0414 10:53:00.963679  600430 preload.go:131] Checking if preload exists for k8s version v1.32.2 and runtime containerd
	I0414 10:53:00.966797  600430 out.go:97] Downloading Kubernetes v1.32.2 preload ...
	I0414 10:53:00.966828  600430 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.32.2-containerd-overlay2-arm64.tar.lz4 ...
	I0414 10:53:01.056254  600430 download.go:108] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.32.2/preloaded-images-k8s-v18-v1.32.2-containerd-overlay2-arm64.tar.lz4?checksum=md5:e856099fc6207e912f24bef3ed2763e0 -> /home/jenkins/minikube-integration/20534-594855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-containerd-overlay2-arm64.tar.lz4
	I0414 10:53:05.675072  600430 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.32.2-containerd-overlay2-arm64.tar.lz4 ...
	I0414 10:53:05.675174  600430 preload.go:254] verifying checksum of /home/jenkins/minikube-integration/20534-594855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-containerd-overlay2-arm64.tar.lz4 ...
	
	
	* The control-plane node download-only-553625 host does not exist
	  To start a cluster, run: "minikube start -p download-only-553625"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.32.2/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/v1.32.2/DeleteAll (0.2s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.32.2/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.32.2/DeleteAll (0.20s)

                                                
                                    
x
+
TestDownloadOnly/v1.32.2/DeleteAlwaysSucceeds (0.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.32.2/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-553625
--- PASS: TestDownloadOnly/v1.32.2/DeleteAlwaysSucceeds (0.13s)

                                                
                                    
x
+
TestBinaryMirror (0.59s)

                                                
                                                
=== RUN   TestBinaryMirror
I0414 10:53:08.753357  600227 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.32.2/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.32.2/bin/linux/arm64/kubectl.sha256
aaa_download_only_test.go:314: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-975326 --alsologtostderr --binary-mirror http://127.0.0.1:42033 --driver=docker  --container-runtime=containerd
helpers_test.go:175: Cleaning up "binary-mirror-975326" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-975326
--- PASS: TestBinaryMirror (0.59s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.07s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:939: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-459233
addons_test.go:939: (dbg) Non-zero exit: out/minikube-linux-arm64 addons enable dashboard -p addons-459233: exit status 85 (72.582919ms)

                                                
                                                
-- stdout --
	* Profile "addons-459233" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-459233"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.07s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.07s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:950: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-459233
addons_test.go:950: (dbg) Non-zero exit: out/minikube-linux-arm64 addons disable dashboard -p addons-459233: exit status 85 (71.827597ms)

                                                
                                                
-- stdout --
	* Profile "addons-459233" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-459233"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.07s)

                                                
                                    
x
+
TestAddons/Setup (216.53s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:107: (dbg) Run:  out/minikube-linux-arm64 start -p addons-459233 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher
addons_test.go:107: (dbg) Done: out/minikube-linux-arm64 start -p addons-459233 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher: (3m36.52929362s)
--- PASS: TestAddons/Setup (216.53s)

                                                
                                    
x
+
TestAddons/serial/Volcano (39.98s)

                                                
                                                
=== RUN   TestAddons/serial/Volcano
addons_test.go:823: volcano-controller stabilized in 61.414029ms
addons_test.go:815: volcano-admission stabilized in 61.750303ms
addons_test.go:807: volcano-scheduler stabilized in 62.674497ms
addons_test.go:829: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-75fdd99bcf-xwls2" [16bc7d08-4b98-4263-9a39-f5a8c0404150] Running
addons_test.go:829: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.003356815s
addons_test.go:833: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-75d8f6b5c-pzk4b" [2c523331-9285-43d6-bae9-bcddaa4d6a12] Running
addons_test.go:833: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.003391489s
addons_test.go:837: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-86bdc5c9c-mbp2z" [e8786421-5a90-42f8-9c44-8b77b1a0a8b6] Running
addons_test.go:837: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.002880741s
addons_test.go:842: (dbg) Run:  kubectl --context addons-459233 delete -n volcano-system job volcano-admission-init
addons_test.go:848: (dbg) Run:  kubectl --context addons-459233 create -f testdata/vcjob.yaml
addons_test.go:856: (dbg) Run:  kubectl --context addons-459233 get vcjob -n my-volcano
addons_test.go:874: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [23243de1-0070-4701-b8f7-a10f4d939821] Pending
helpers_test.go:344: "test-job-nginx-0" [23243de1-0070-4701-b8f7-a10f4d939821] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "test-job-nginx-0" [23243de1-0070-4701-b8f7-a10f4d939821] Running
addons_test.go:874: (dbg) TestAddons/serial/Volcano: volcano.sh/job-name=test-job healthy within 12.003181269s
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 addons disable volcano --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-459233 addons disable volcano --alsologtostderr -v=1: (11.349728794s)
--- PASS: TestAddons/serial/Volcano (39.98s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.18s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:569: (dbg) Run:  kubectl --context addons-459233 create ns new-namespace
addons_test.go:583: (dbg) Run:  kubectl --context addons-459233 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.18s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/FakeCredentials (9.87s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/FakeCredentials
addons_test.go:614: (dbg) Run:  kubectl --context addons-459233 create -f testdata/busybox.yaml
addons_test.go:621: (dbg) Run:  kubectl --context addons-459233 create sa gcp-auth-test
addons_test.go:627: (dbg) TestAddons/serial/GCPAuth/FakeCredentials: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [39acd728-1baf-4d2a-9680-0a33eb542cf3] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [39acd728-1baf-4d2a-9680-0a33eb542cf3] Running
addons_test.go:627: (dbg) TestAddons/serial/GCPAuth/FakeCredentials: integration-test=busybox healthy within 9.003195195s
addons_test.go:633: (dbg) Run:  kubectl --context addons-459233 exec busybox -- /bin/sh -c "printenv GOOGLE_APPLICATION_CREDENTIALS"
addons_test.go:645: (dbg) Run:  kubectl --context addons-459233 describe sa gcp-auth-test
addons_test.go:659: (dbg) Run:  kubectl --context addons-459233 exec busybox -- /bin/sh -c "cat /google-app-creds.json"
addons_test.go:683: (dbg) Run:  kubectl --context addons-459233 exec busybox -- /bin/sh -c "printenv GOOGLE_CLOUD_PROJECT"
--- PASS: TestAddons/serial/GCPAuth/FakeCredentials (9.87s)

                                                
                                    
x
+
TestAddons/parallel/Registry (14.57s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:321: registry stabilized in 7.903989ms
addons_test.go:323: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-6c88467877-476n2" [862d576c-f593-4fc6-a1fe-a97925910df6] Running
addons_test.go:323: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.00302941s
addons_test.go:326: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-vzbgv" [1a5b8066-042d-4d45-9441-dac2f3d10e6b] Running
addons_test.go:326: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.00295312s
addons_test.go:331: (dbg) Run:  kubectl --context addons-459233 delete po -l run=registry-test --now
addons_test.go:336: (dbg) Run:  kubectl --context addons-459233 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:336: (dbg) Done: kubectl --context addons-459233 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.65757789s)
addons_test.go:350: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 ip
2025/04/14 10:57:58 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (14.57s)

                                                
                                    
x
+
TestAddons/parallel/Ingress (19.69s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:207: (dbg) Run:  kubectl --context addons-459233 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:232: (dbg) Run:  kubectl --context addons-459233 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:245: (dbg) Run:  kubectl --context addons-459233 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [0499f708-a3d9-4142-b226-790e24b06c1e] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [0499f708-a3d9-4142-b226-790e24b06c1e] Running
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 9.004821263s
I0414 10:59:09.675795  600227 kapi.go:150] Service nginx in namespace default found.
addons_test.go:262: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:286: (dbg) Run:  kubectl --context addons-459233 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:291: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 ip
addons_test.go:297: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-459233 addons disable ingress-dns --alsologtostderr -v=1: (1.424276896s)
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 addons disable ingress --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-459233 addons disable ingress --alsologtostderr -v=1: (7.716539789s)
--- PASS: TestAddons/parallel/Ingress (19.69s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (11.75s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:762: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-rpzrh" [fa9ca331-baf9-4d1b-8323-896434da1007] Running
addons_test.go:762: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 6.00315247s
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 addons disable inspektor-gadget --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-459233 addons disable inspektor-gadget --alsologtostderr -v=1: (5.742978072s)
--- PASS: TestAddons/parallel/InspektorGadget (11.75s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.75s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:394: metrics-server stabilized in 4.508131ms
addons_test.go:396: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-7fbb699795-ldvc5" [49eca64b-7027-494e-b7f5-d13f7ce7c1b7] Running
addons_test.go:396: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.003802146s
addons_test.go:402: (dbg) Run:  kubectl --context addons-459233 top pods -n kube-system
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.75s)

                                                
                                    
x
+
TestAddons/parallel/CSI (34.19s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
I0414 10:58:25.897380  600227 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0414 10:58:25.900846  600227 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0414 10:58:25.900868  600227 kapi.go:107] duration metric: took 6.398472ms to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
addons_test.go:488: csi-hostpath-driver pods stabilized in 6.406833ms
addons_test.go:491: (dbg) Run:  kubectl --context addons-459233 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:496: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:501: (dbg) Run:  kubectl --context addons-459233 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:506: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [a9b6aa24-6731-4583-9360-148551ebe808] Pending
helpers_test.go:344: "task-pv-pod" [a9b6aa24-6731-4583-9360-148551ebe808] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [a9b6aa24-6731-4583-9360-148551ebe808] Running
addons_test.go:506: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 7.003788571s
addons_test.go:511: (dbg) Run:  kubectl --context addons-459233 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:516: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-459233 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-459233 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:521: (dbg) Run:  kubectl --context addons-459233 delete pod task-pv-pod
addons_test.go:527: (dbg) Run:  kubectl --context addons-459233 delete pvc hpvc
addons_test.go:533: (dbg) Run:  kubectl --context addons-459233 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:538: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:543: (dbg) Run:  kubectl --context addons-459233 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:548: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [59b7840f-17a8-40a3-94c5-68af7ac8514b] Pending
helpers_test.go:344: "task-pv-pod-restore" [59b7840f-17a8-40a3-94c5-68af7ac8514b] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [59b7840f-17a8-40a3-94c5-68af7ac8514b] Running
addons_test.go:548: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.004346537s
addons_test.go:553: (dbg) Run:  kubectl --context addons-459233 delete pod task-pv-pod-restore
addons_test.go:557: (dbg) Run:  kubectl --context addons-459233 delete pvc hpvc-restore
addons_test.go:561: (dbg) Run:  kubectl --context addons-459233 delete volumesnapshot new-snapshot-demo
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 addons disable volumesnapshots --alsologtostderr -v=1
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-459233 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.775947914s)
--- PASS: TestAddons/parallel/CSI (34.19s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (16.77s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:747: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-459233 --alsologtostderr -v=1
addons_test.go:747: (dbg) Done: out/minikube-linux-arm64 addons enable headlamp -p addons-459233 --alsologtostderr -v=1: (1.039697409s)
addons_test.go:752: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-5d4b5d7bd6-69jqp" [1ad74392-b870-4042-8abd-875c3588df68] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-5d4b5d7bd6-69jqp" [1ad74392-b870-4042-8abd-875c3588df68] Running
addons_test.go:752: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 10.002789776s
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 addons disable headlamp --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-459233 addons disable headlamp --alsologtostderr -v=1: (5.726682615s)
--- PASS: TestAddons/parallel/Headlamp (16.77s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.59s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:779: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-7dc7f9b5b8-t2n7w" [85560bce-c6f8-4c06-887a-ca2e5f1855f3] Running
addons_test.go:779: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.003794993s
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 addons disable cloud-spanner --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CloudSpanner (5.59s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (51.52s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:888: (dbg) Run:  kubectl --context addons-459233 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:894: (dbg) Run:  kubectl --context addons-459233 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:898: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-459233 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:901: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [8b5d20cd-b90d-44da-9560-5e0d51a668de] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [8b5d20cd-b90d-44da-9560-5e0d51a668de] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [8b5d20cd-b90d-44da-9560-5e0d51a668de] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:901: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 3.003150483s
addons_test.go:906: (dbg) Run:  kubectl --context addons-459233 get pvc test-pvc -o=json
addons_test.go:915: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 ssh "cat /opt/local-path-provisioner/pvc-08413d07-e85f-4d7c-be00-97da5d1b4d1d_default_test-pvc/file1"
addons_test.go:927: (dbg) Run:  kubectl --context addons-459233 delete pod test-local-path
addons_test.go:931: (dbg) Run:  kubectl --context addons-459233 delete pvc test-pvc
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-459233 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (43.321399875s)
--- PASS: TestAddons/parallel/LocalPath (51.52s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (6.64s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:964: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-ddr9d" [0beaef6f-8c66-4ab3-83e9-0bdd18241ae1] Running
addons_test.go:964: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 6.002693141s
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 addons disable nvidia-device-plugin --alsologtostderr -v=1
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (6.64s)

                                                
                                    
x
+
TestAddons/parallel/Yakd (11.82s)

                                                
                                                
=== RUN   TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Yakd
addons_test.go:986: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:344: "yakd-dashboard-575dd5996b-lmlnp" [86e0f6de-8a45-4475-9daf-c3f6a5ee5a2a] Running
addons_test.go:986: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 6.003031654s
addons_test.go:992: (dbg) Run:  out/minikube-linux-arm64 -p addons-459233 addons disable yakd --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-arm64 -p addons-459233 addons disable yakd --alsologtostderr -v=1: (5.813786554s)
--- PASS: TestAddons/parallel/Yakd (11.82s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (12.25s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:170: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-459233
addons_test.go:170: (dbg) Done: out/minikube-linux-arm64 stop -p addons-459233: (11.972830563s)
addons_test.go:174: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-459233
addons_test.go:178: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-459233
addons_test.go:183: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-459233
--- PASS: TestAddons/StoppedEnableDisable (12.25s)

                                                
                                    
x
+
TestCertOptions (32.77s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-253833 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd
cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-253833 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd: (30.158627994s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-253833 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-253833 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-253833 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-253833" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-253833
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-253833: (1.965098039s)
--- PASS: TestCertOptions (32.77s)

                                                
                                    
x
+
TestCertExpiration (228.43s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-541494 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd
cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-541494 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd: (37.979234505s)
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-541494 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd
cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-541494 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd: (8.067343793s)
helpers_test.go:175: Cleaning up "cert-expiration-541494" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-541494
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-541494: (2.380750126s)
--- PASS: TestCertExpiration (228.43s)

                                                
                                    
x
+
TestForceSystemdFlag (38.91s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-092734 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
E0414 11:34:49.054321  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
docker_test.go:91: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-092734 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (36.646505198s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-092734 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-flag-092734" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-092734
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-092734: (1.975862483s)
--- PASS: TestForceSystemdFlag (38.91s)

                                                
                                    
x
+
TestForceSystemdEnv (39.12s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-019998 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
E0414 11:33:14.058391  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
docker_test.go:155: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-019998 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (36.811812979s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-env-019998 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-env-019998" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-019998
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-019998: (2.024534576s)
--- PASS: TestForceSystemdEnv (39.12s)

                                                
                                    
x
+
TestDockerEnvContainerd (47.21s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with containerd true linux arm64
docker_test.go:181: (dbg) Run:  out/minikube-linux-arm64 start -p dockerenv-838354 --driver=docker  --container-runtime=containerd
docker_test.go:181: (dbg) Done: out/minikube-linux-arm64 start -p dockerenv-838354 --driver=docker  --container-runtime=containerd: (31.72514703s)
docker_test.go:189: (dbg) Run:  /bin/bash -c "out/minikube-linux-arm64 docker-env --ssh-host --ssh-add -p dockerenv-838354"
docker_test.go:220: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-3FCB2LJqs4vC/agent.621742" SSH_AGENT_PID="621743" DOCKER_HOST=ssh://docker@127.0.0.1:33515 docker version"
docker_test.go:243: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-3FCB2LJqs4vC/agent.621742" SSH_AGENT_PID="621743" DOCKER_HOST=ssh://docker@127.0.0.1:33515 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env"
docker_test.go:243: (dbg) Done: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-3FCB2LJqs4vC/agent.621742" SSH_AGENT_PID="621743" DOCKER_HOST=ssh://docker@127.0.0.1:33515 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env": (1.100142851s)
docker_test.go:250: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-3FCB2LJqs4vC/agent.621742" SSH_AGENT_PID="621743" DOCKER_HOST=ssh://docker@127.0.0.1:33515 docker image ls"
helpers_test.go:175: Cleaning up "dockerenv-838354" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p dockerenv-838354
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p dockerenv-838354: (1.972380095s)
--- PASS: TestDockerEnvContainerd (47.21s)

                                                
                                    
x
+
TestErrorSpam/setup (28.77s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-370078 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-370078 --driver=docker  --container-runtime=containerd
error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-370078 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-370078 --driver=docker  --container-runtime=containerd: (28.765857987s)
--- PASS: TestErrorSpam/setup (28.77s)

                                                
                                    
x
+
TestErrorSpam/start (0.74s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 start --dry-run
--- PASS: TestErrorSpam/start (0.74s)

                                                
                                    
x
+
TestErrorSpam/status (1.09s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 status
--- PASS: TestErrorSpam/status (1.09s)

                                                
                                    
x
+
TestErrorSpam/pause (1.73s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 pause
--- PASS: TestErrorSpam/pause (1.73s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.76s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 unpause
--- PASS: TestErrorSpam/unpause (1.76s)

                                                
                                    
x
+
TestErrorSpam/stop (1.43s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 stop: (1.23172052s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-370078 --log_dir /tmp/nospam-370078 stop
--- PASS: TestErrorSpam/stop (1.43s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1872: local sync path: /home/jenkins/minikube-integration/20534-594855/.minikube/files/etc/test/nested/copy/600227/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (45.44s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2251: (dbg) Run:  out/minikube-linux-arm64 start -p functional-068510 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd
E0414 11:01:45.983957  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:01:45.990898  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:01:46.002259  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:01:46.023704  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:01:46.065165  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:01:46.146550  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:01:46.308085  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:01:46.629730  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:01:47.271740  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:01:48.553308  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
functional_test.go:2251: (dbg) Done: out/minikube-linux-arm64 start -p functional-068510 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd: (45.434058689s)
--- PASS: TestFunctional/serial/StartWithProxy (45.44s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (6.02s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
I0414 11:01:50.857366  600227 config.go:182] Loaded profile config "functional-068510": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
functional_test.go:676: (dbg) Run:  out/minikube-linux-arm64 start -p functional-068510 --alsologtostderr -v=8
E0414 11:01:51.114846  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:01:56.237177  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
functional_test.go:676: (dbg) Done: out/minikube-linux-arm64 start -p functional-068510 --alsologtostderr -v=8: (6.015473364s)
functional_test.go:680: soft start took 6.01794196s for "functional-068510" cluster.
I0414 11:01:56.873165  600227 config.go:182] Loaded profile config "functional-068510": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
--- PASS: TestFunctional/serial/SoftStart (6.02s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:698: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.06s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:713: (dbg) Run:  kubectl --context functional-068510 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (3.93s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1066: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 cache add registry.k8s.io/pause:3.1
functional_test.go:1066: (dbg) Done: out/minikube-linux-arm64 -p functional-068510 cache add registry.k8s.io/pause:3.1: (1.526156008s)
functional_test.go:1066: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 cache add registry.k8s.io/pause:3.3
functional_test.go:1066: (dbg) Done: out/minikube-linux-arm64 -p functional-068510 cache add registry.k8s.io/pause:3.3: (1.286320641s)
functional_test.go:1066: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 cache add registry.k8s.io/pause:latest
functional_test.go:1066: (dbg) Done: out/minikube-linux-arm64 -p functional-068510 cache add registry.k8s.io/pause:latest: (1.113206047s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (3.93s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.22s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1094: (dbg) Run:  docker build -t minikube-local-cache-test:functional-068510 /tmp/TestFunctionalserialCacheCmdcacheadd_local2232196741/001
functional_test.go:1106: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 cache add minikube-local-cache-test:functional-068510
functional_test.go:1111: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 cache delete minikube-local-cache-test:functional-068510
functional_test.go:1100: (dbg) Run:  docker rmi minikube-local-cache-test:functional-068510
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.22s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1119: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1127: (dbg) Run:  out/minikube-linux-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.28s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1141: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.28s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (2.03s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1164: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh sudo crictl rmi registry.k8s.io/pause:latest
functional_test.go:1170: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1170: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-068510 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (283.964629ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1175: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 cache reload
functional_test.go:1175: (dbg) Done: out/minikube-linux-arm64 -p functional-068510 cache reload: (1.136367519s)
functional_test.go:1180: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (2.03s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1189: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1189: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.11s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:733: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 kubectl -- --context functional-068510 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.13s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:758: (dbg) Run:  out/kubectl --context functional-068510 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.13s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (58.92s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:774: (dbg) Run:  out/minikube-linux-arm64 start -p functional-068510 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E0414 11:02:06.479040  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:02:26.960931  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
functional_test.go:774: (dbg) Done: out/minikube-linux-arm64 start -p functional-068510 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (58.91871379s)
functional_test.go:778: restart took 58.918803621s for "functional-068510" cluster.
I0414 11:03:03.894775  600227 config.go:182] Loaded profile config "functional-068510": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
--- PASS: TestFunctional/serial/ExtraConfig (58.92s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:827: (dbg) Run:  kubectl --context functional-068510 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:842: etcd phase: Running
functional_test.go:852: etcd status: Ready
functional_test.go:842: kube-apiserver phase: Running
functional_test.go:852: kube-apiserver status: Ready
functional_test.go:842: kube-controller-manager phase: Running
functional_test.go:852: kube-controller-manager status: Ready
functional_test.go:842: kube-scheduler phase: Running
functional_test.go:852: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.09s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.69s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1253: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 logs
functional_test.go:1253: (dbg) Done: out/minikube-linux-arm64 -p functional-068510 logs: (1.691282405s)
--- PASS: TestFunctional/serial/LogsCmd (1.69s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.71s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1267: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 logs --file /tmp/TestFunctionalserialLogsFileCmd3567772214/001/logs.txt
functional_test.go:1267: (dbg) Done: out/minikube-linux-arm64 -p functional-068510 logs --file /tmp/TestFunctionalserialLogsFileCmd3567772214/001/logs.txt: (1.713225475s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.71s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.89s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2338: (dbg) Run:  kubectl --context functional-068510 apply -f testdata/invalidsvc.yaml
E0414 11:03:07.923063  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
functional_test.go:2352: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-068510
functional_test.go:2352: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-068510: exit status 115 (538.136911ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:30193 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2344: (dbg) Run:  kubectl --context functional-068510 delete -f testdata/invalidsvc.yaml
functional_test.go:2344: (dbg) Done: kubectl --context functional-068510 delete -f testdata/invalidsvc.yaml: (1.102940461s)
--- PASS: TestFunctional/serial/InvalidService (4.89s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.46s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1216: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 config unset cpus
functional_test.go:1216: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 config get cpus
functional_test.go:1216: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-068510 config get cpus: exit status 14 (76.939223ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1216: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 config set cpus 2
functional_test.go:1216: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 config get cpus
functional_test.go:1216: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 config unset cpus
functional_test.go:1216: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 config get cpus
functional_test.go:1216: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-068510 config get cpus: exit status 14 (69.606981ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.46s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (11.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:922: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-068510 --alsologtostderr -v=1]
functional_test.go:927: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-068510 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 636963: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (11.25s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.42s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:991: (dbg) Run:  out/minikube-linux-arm64 start -p functional-068510 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:991: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-068510 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (191.34054ms)

                                                
                                                
-- stdout --
	* [functional-068510] minikube v1.35.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=20534
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0414 11:03:45.317532  636540 out.go:345] Setting OutFile to fd 1 ...
	I0414 11:03:45.317703  636540 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:03:45.317714  636540 out.go:358] Setting ErrFile to fd 2...
	I0414 11:03:45.317719  636540 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:03:45.318012  636540 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
	I0414 11:03:45.318398  636540 out.go:352] Setting JSON to false
	I0414 11:03:45.319275  636540 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":9971,"bootTime":1744618655,"procs":206,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1081-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0414 11:03:45.319337  636540 start.go:139] virtualization:  
	I0414 11:03:45.322628  636540 out.go:177] * [functional-068510] minikube v1.35.0 on Ubuntu 20.04 (arm64)
	I0414 11:03:45.326355  636540 out.go:177]   - MINIKUBE_LOCATION=20534
	I0414 11:03:45.326437  636540 notify.go:220] Checking for updates...
	I0414 11:03:45.331874  636540 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0414 11:03:45.334550  636540 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig
	I0414 11:03:45.337314  636540 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube
	I0414 11:03:45.340201  636540 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0414 11:03:45.344092  636540 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0414 11:03:45.350263  636540 config.go:182] Loaded profile config "functional-068510": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
	I0414 11:03:45.350895  636540 driver.go:394] Setting default libvirt URI to qemu:///system
	I0414 11:03:45.376745  636540 docker.go:123] docker version: linux-28.0.4:Docker Engine - Community
	I0414 11:03:45.376864  636540 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0414 11:03:45.430242  636540 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:36 OomKillDisable:true NGoroutines:53 SystemTime:2025-04-14 11:03:45.421766132 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1081-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0]] Warnings:<nil>}}
	I0414 11:03:45.430343  636540 docker.go:318] overlay module found
	I0414 11:03:45.433415  636540 out.go:177] * Using the docker driver based on existing profile
	I0414 11:03:45.436168  636540 start.go:297] selected driver: docker
	I0414 11:03:45.436187  636540 start.go:901] validating driver "docker" against &{Name:functional-068510 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:functional-068510 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.32.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0414 11:03:45.436293  636540 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0414 11:03:45.439651  636540 out.go:201] 
	W0414 11:03:45.442508  636540 out.go:270] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0414 11:03:45.445268  636540 out.go:201] 

                                                
                                                
** /stderr **
functional_test.go:1008: (dbg) Run:  out/minikube-linux-arm64 start -p functional-068510 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
--- PASS: TestFunctional/parallel/DryRun (0.42s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1037: (dbg) Run:  out/minikube-linux-arm64 start -p functional-068510 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:1037: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-068510 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (282.939881ms)

                                                
                                                
-- stdout --
	* [functional-068510] minikube v1.35.0 sur Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=20534
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0414 11:03:45.054395  636447 out.go:345] Setting OutFile to fd 1 ...
	I0414 11:03:45.054612  636447 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:03:45.054636  636447 out.go:358] Setting ErrFile to fd 2...
	I0414 11:03:45.054655  636447 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:03:45.055653  636447 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
	I0414 11:03:45.056133  636447 out.go:352] Setting JSON to false
	I0414 11:03:45.057206  636447 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":9970,"bootTime":1744618655,"procs":206,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1081-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0414 11:03:45.057306  636447 start.go:139] virtualization:  
	I0414 11:03:45.063194  636447 out.go:177] * [functional-068510] minikube v1.35.0 sur Ubuntu 20.04 (arm64)
	I0414 11:03:45.066310  636447 out.go:177]   - MINIKUBE_LOCATION=20534
	I0414 11:03:45.066353  636447 notify.go:220] Checking for updates...
	I0414 11:03:45.069827  636447 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0414 11:03:45.072389  636447 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig
	I0414 11:03:45.078320  636447 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube
	I0414 11:03:45.081643  636447 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0414 11:03:45.085124  636447 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0414 11:03:45.088553  636447 config.go:182] Loaded profile config "functional-068510": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
	I0414 11:03:45.089243  636447 driver.go:394] Setting default libvirt URI to qemu:///system
	I0414 11:03:45.127924  636447 docker.go:123] docker version: linux-28.0.4:Docker Engine - Community
	I0414 11:03:45.128040  636447 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0414 11:03:45.233889  636447 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:36 OomKillDisable:true NGoroutines:53 SystemTime:2025-04-14 11:03:45.223416119 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1081-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0]] Warnings:<nil>}}
	I0414 11:03:45.233983  636447 docker.go:318] overlay module found
	I0414 11:03:45.237651  636447 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0414 11:03:45.240855  636447 start.go:297] selected driver: docker
	I0414 11:03:45.240876  636447 start.go:901] validating driver "docker" against &{Name:functional-068510 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1744107393-20604@sha256:2430533582a8c08f907b2d5976c79bd2e672b4f3d4484088c99b839f3175ed6a Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:functional-068510 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.32.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0414 11:03:45.241006  636447 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0414 11:03:45.245581  636447 out.go:201] 
	W0414 11:03:45.248481  636447 out.go:270] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0414 11:03:45.251334  636447 out.go:201] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (0.97s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:871: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 status
functional_test.go:877: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:889: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (0.97s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (9.69s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1644: (dbg) Run:  kubectl --context functional-068510 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1652: (dbg) Run:  kubectl --context functional-068510 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1657: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-8449669db6-6s8dq" [763c618b-29c7-4090-ae2f-f6cdce72bd7b] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-connect-8449669db6-6s8dq" [763c618b-29c7-4090-ae2f-f6cdce72bd7b] Running
functional_test.go:1657: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 9.003303421s
functional_test.go:1666: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 service hello-node-connect --url
functional_test.go:1672: found endpoint for hello-node-connect: http://192.168.49.2:31018
functional_test.go:1692: http://192.168.49.2:31018: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-8449669db6-6s8dq

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:31018
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (9.69s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1707: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 addons list
functional_test.go:1719: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (25.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [3a319d70-bd5c-4b71-a6cb-fee7a896ed55] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 6.002971742s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-068510 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-068510 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-068510 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-068510 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [2ac517e8-74eb-4ed8-8c77-4373fd90e590] Pending
helpers_test.go:344: "sp-pod" [2ac517e8-74eb-4ed8-8c77-4373fd90e590] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [2ac517e8-74eb-4ed8-8c77-4373fd90e590] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 11.002994614s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-068510 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-068510 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:106: (dbg) Done: kubectl --context functional-068510 delete -f testdata/storage-provisioner/pod.yaml: (1.181268409s)
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-068510 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [f6ccc833-0e90-4898-959f-d0a58f995578] Pending
helpers_test.go:344: "sp-pod" [f6ccc833-0e90-4898-959f-d0a58f995578] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 6.003499544s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-068510 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (25.14s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1742: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "echo hello"
functional_test.go:1759: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.70s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (2.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh -n functional-068510 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 cp functional-068510:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd3682339175/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh -n functional-068510 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh -n functional-068510 "sudo cat /tmp/does/not/exist/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (2.24s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1946: Checking for existence of /etc/test/nested/copy/600227/hosts within VM
functional_test.go:1948: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "sudo cat /etc/test/nested/copy/600227/hosts"
functional_test.go:1953: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.38s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (2.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1989: Checking for existence of /etc/ssl/certs/600227.pem within VM
functional_test.go:1990: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "sudo cat /etc/ssl/certs/600227.pem"
functional_test.go:1989: Checking for existence of /usr/share/ca-certificates/600227.pem within VM
functional_test.go:1990: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "sudo cat /usr/share/ca-certificates/600227.pem"
functional_test.go:1989: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1990: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:2016: Checking for existence of /etc/ssl/certs/6002272.pem within VM
functional_test.go:2017: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "sudo cat /etc/ssl/certs/6002272.pem"
functional_test.go:2016: Checking for existence of /usr/share/ca-certificates/6002272.pem within VM
functional_test.go:2017: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "sudo cat /usr/share/ca-certificates/6002272.pem"
functional_test.go:2016: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:2017: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (2.08s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:236: (dbg) Run:  kubectl --context functional-068510 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.64s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2044: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "sudo systemctl is-active docker"
functional_test.go:2044: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-068510 ssh "sudo systemctl is-active docker": exit status 1 (319.990984ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
functional_test.go:2044: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "sudo systemctl is-active crio"
functional_test.go:2044: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-068510 ssh "sudo systemctl is-active crio": exit status 1 (317.24205ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.64s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2305: (dbg) Run:  out/minikube-linux-arm64 license
--- PASS: TestFunctional/parallel/License (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.61s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-068510 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-068510 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-068510 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 633867: os: process already finished
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-068510 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.61s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-arm64 -p functional-068510 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (9.44s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-068510 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [98546b87-f477-4e55-a113-e6139b58fa96] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [98546b87-f477-4e55-a113-e6139b58fa96] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 9.002943383s
I0414 11:03:23.499613  600227 kapi.go:150] Service nginx-svc in namespace default found.
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (9.44s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-068510 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.96.106.208 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-arm64 -p functional-068510 tunnel --alsologtostderr] ...
functional_test_tunnel_test.go:437: failed to stop process: signal: terminated
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (8.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1454: (dbg) Run:  kubectl --context functional-068510 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1462: (dbg) Run:  kubectl --context functional-068510 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1467: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-64fc58db8c-qvtbh" [f240ea38-8bfb-4965-9444-af2383e473da] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-64fc58db8c-qvtbh" [f240ea38-8bfb-4965-9444-af2383e473da] Running
functional_test.go:1467: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 8.004414988s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (8.20s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.42s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1287: (dbg) Run:  out/minikube-linux-arm64 profile lis
functional_test.go:1292: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.42s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1327: (dbg) Run:  out/minikube-linux-arm64 profile list
functional_test.go:1332: Took "349.688306ms" to run "out/minikube-linux-arm64 profile list"
functional_test.go:1341: (dbg) Run:  out/minikube-linux-arm64 profile list -l
functional_test.go:1346: Took "56.062936ms" to run "out/minikube-linux-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.41s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1378: (dbg) Run:  out/minikube-linux-arm64 profile list -o json
functional_test.go:1383: Took "340.946073ms" to run "out/minikube-linux-arm64 profile list -o json"
functional_test.go:1391: (dbg) Run:  out/minikube-linux-arm64 profile list -o json --light
functional_test.go:1396: Took "56.90141ms" to run "out/minikube-linux-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.40s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (7.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-068510 /tmp/TestFunctionalparallelMountCmdany-port1679517404/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1744628620895864565" to /tmp/TestFunctionalparallelMountCmdany-port1679517404/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1744628620895864565" to /tmp/TestFunctionalparallelMountCmdany-port1679517404/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1744628620895864565" to /tmp/TestFunctionalparallelMountCmdany-port1679517404/001/test-1744628620895864565
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-068510 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (354.606682ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
I0414 11:03:41.251906  600227 retry.go:31] will retry after 385.80132ms: exit status 1
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Apr 14 11:03 created-by-test
-rw-r--r-- 1 docker docker 24 Apr 14 11:03 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Apr 14 11:03 test-1744628620895864565
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh cat /mount-9p/test-1744628620895864565
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-068510 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [0a2f1cf1-dafe-40b3-bd3b-1cce81fa7ad5] Pending
helpers_test.go:344: "busybox-mount" [0a2f1cf1-dafe-40b3-bd3b-1cce81fa7ad5] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [0a2f1cf1-dafe-40b3-bd3b-1cce81fa7ad5] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [0a2f1cf1-dafe-40b3-bd3b-1cce81fa7ad5] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.003083765s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-068510 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-068510 /tmp/TestFunctionalparallelMountCmdany-port1679517404/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (7.09s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.57s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1476: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.57s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.55s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1506: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 service list -o json
functional_test.go:1511: Took "554.157577ms" to run "out/minikube-linux-arm64 -p functional-068510 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.55s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1526: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 service --namespace=default --https --url hello-node
functional_test.go:1539: found endpoint: https://192.168.49.2:30497
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.36s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1557: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.36s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.36s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1576: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 service hello-node --url
functional_test.go:1582: found endpoint for hello-node: http://192.168.49.2:30497
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.36s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (2.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-068510 /tmp/TestFunctionalparallelMountCmdspecific-port829788216/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-068510 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (487.510174ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
I0414 11:03:48.474301  600227 retry.go:31] will retry after 490.719843ms: exit status 1
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-068510 /tmp/TestFunctionalparallelMountCmdspecific-port829788216/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-068510 ssh "sudo umount -f /mount-9p": exit status 1 (381.067837ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-068510 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-068510 /tmp/TestFunctionalparallelMountCmdspecific-port829788216/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.15s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (1.81s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-068510 /tmp/TestFunctionalparallelMountCmdVerifyCleanup979145029/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-068510 /tmp/TestFunctionalparallelMountCmdVerifyCleanup979145029/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-068510 /tmp/TestFunctionalparallelMountCmdVerifyCleanup979145029/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Done: out/minikube-linux-arm64 -p functional-068510 ssh "findmnt -T" /mount1: (1.015096507s)
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-arm64 mount -p functional-068510 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-068510 /tmp/TestFunctionalparallelMountCmdVerifyCleanup979145029/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-068510 /tmp/TestFunctionalparallelMountCmdVerifyCleanup979145029/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-068510 /tmp/TestFunctionalparallelMountCmdVerifyCleanup979145029/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (1.81s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2273: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 version --short
--- PASS: TestFunctional/parallel/Version/short (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (1.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2287: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 version -o=json --components
functional_test.go:2287: (dbg) Done: out/minikube-linux-arm64 -p functional-068510 version -o=json --components: (1.39059276s)
--- PASS: TestFunctional/parallel/Version/components (1.39s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:278: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image ls --format short --alsologtostderr
functional_test.go:283: (dbg) Stdout: out/minikube-linux-arm64 -p functional-068510 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.10
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.32.2
registry.k8s.io/kube-proxy:v1.32.2
registry.k8s.io/kube-controller-manager:v1.32.2
registry.k8s.io/kube-apiserver:v1.32.2
registry.k8s.io/etcd:3.5.16-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.11.3
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/minikube-local-cache-test:functional-068510
docker.io/kindest/kindnetd:v20250214-acbabc1a
docker.io/kindest/kindnetd:v20241212-9f82dd49
docker.io/kicbase/echo-server:functional-068510
functional_test.go:286: (dbg) Stderr: out/minikube-linux-arm64 -p functional-068510 image ls --format short --alsologtostderr:
I0414 11:04:00.302743  639351 out.go:345] Setting OutFile to fd 1 ...
I0414 11:04:00.302838  639351 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 11:04:00.302843  639351 out.go:358] Setting ErrFile to fd 2...
I0414 11:04:00.302853  639351 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 11:04:00.303184  639351 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
I0414 11:04:00.304048  639351 config.go:182] Loaded profile config "functional-068510": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
I0414 11:04:00.304185  639351 config.go:182] Loaded profile config "functional-068510": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
I0414 11:04:00.304823  639351 cli_runner.go:164] Run: docker container inspect functional-068510 --format={{.State.Status}}
I0414 11:04:00.326427  639351 ssh_runner.go:195] Run: systemctl --version
I0414 11:04:00.326517  639351 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-068510
I0414 11:04:00.346559  639351 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33525 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/functional-068510/id_rsa Username:docker}
I0414 11:04:00.438396  639351 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:278: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image ls --format table --alsologtostderr
functional_test.go:283: (dbg) Stdout: out/minikube-linux-arm64 -p functional-068510 image ls --format table --alsologtostderr:
|---------------------------------------------|--------------------|---------------|--------|
|                    Image                    |        Tag         |   Image ID    |  Size  |
|---------------------------------------------|--------------------|---------------|--------|
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc       | sha256:1611cd | 1.94MB |
| registry.k8s.io/pause                       | 3.10               | sha256:afb617 | 268kB  |
| docker.io/kindest/kindnetd                  | v20241212-9f82dd49 | sha256:e1181e | 35.7MB |
| docker.io/library/nginx                     | latest             | sha256:1530d8 | 68.7MB |
| registry.k8s.io/coredns/coredns             | v1.11.3            | sha256:2f6c96 | 16.9MB |
| registry.k8s.io/etcd                        | 3.5.16-0           | sha256:7fc9d4 | 67.9MB |
| registry.k8s.io/kube-scheduler              | v1.32.2            | sha256:82dfa0 | 18.9MB |
| registry.k8s.io/pause                       | 3.1                | sha256:8057e0 | 262kB  |
| docker.io/kindest/kindnetd                  | v20250214-acbabc1a | sha256:ee75e2 | 35.7MB |
| docker.io/library/minikube-local-cache-test | functional-068510  | sha256:1ac5ce | 992B   |
| docker.io/library/nginx                     | alpine             | sha256:cedb66 | 21.7MB |
| gcr.io/k8s-minikube/storage-provisioner     | v5                 | sha256:ba04bb | 8.03MB |
| registry.k8s.io/pause                       | latest             | sha256:8cb209 | 71.3kB |
| docker.io/kicbase/echo-server               | functional-068510  | sha256:ce2d2c | 2.17MB |
| registry.k8s.io/echoserver-arm              | 1.8                | sha256:72565b | 45.3MB |
| registry.k8s.io/kube-apiserver              | v1.32.2            | sha256:6417e1 | 26.2MB |
| registry.k8s.io/kube-controller-manager     | v1.32.2            | sha256:3c9285 | 24MB   |
| registry.k8s.io/kube-proxy                  | v1.32.2            | sha256:e5aac5 | 27.4MB |
| registry.k8s.io/pause                       | 3.3                | sha256:3d1873 | 249kB  |
|---------------------------------------------|--------------------|---------------|--------|
functional_test.go:286: (dbg) Stderr: out/minikube-linux-arm64 -p functional-068510 image ls --format table --alsologtostderr:
I0414 11:04:01.187626  639532 out.go:345] Setting OutFile to fd 1 ...
I0414 11:04:01.187762  639532 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 11:04:01.187787  639532 out.go:358] Setting ErrFile to fd 2...
I0414 11:04:01.187799  639532 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 11:04:01.188074  639532 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
I0414 11:04:01.188715  639532 config.go:182] Loaded profile config "functional-068510": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
I0414 11:04:01.188844  639532 config.go:182] Loaded profile config "functional-068510": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
I0414 11:04:01.189493  639532 cli_runner.go:164] Run: docker container inspect functional-068510 --format={{.State.Status}}
I0414 11:04:01.209941  639532 ssh_runner.go:195] Run: systemctl --version
I0414 11:04:01.209994  639532 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-068510
I0414 11:04:01.240520  639532 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33525 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/functional-068510/id_rsa Username:docker}
I0414 11:04:01.326491  639532 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:278: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image ls --format json --alsologtostderr
functional_test.go:283: (dbg) Stdout: out/minikube-linux-arm64 -p functional-068510 image ls --format json --alsologtostderr:
[{"id":"sha256:ee75e27fff91c8d59835f9a3efdf968ff404e580bad69746a65bcf3e304ab26f","repoDigests":["docker.io/kindest/kindnetd@sha256:e3c42406b0806c1f7e8a66838377936cbd2cdfd94d9b26a3eefedada8713d495"],"repoTags":["docker.io/kindest/kindnetd:v20250214-acbabc1a"],"size":"35677907"},{"id":"sha256:1ac5ce6345e439b7c7033cc7e8fca9183da03eb998e46486f7530f655a139a0b","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-068510"],"size":"992"},{"id":"sha256:cedb667e1a7b4e6d843a4f74f1f2db0dac1c29b43978aa72dbae2193e3b8eea3","repoDigests":["docker.io/library/nginx@sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591"],"repoTags":["docker.io/library/nginx:alpine"],"size":"21684747"},{"id":"sha256:1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"1935750"},{"id":"sha256:72565
bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":["registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5"],"repoTags":["registry.k8s.io/echoserver-arm:1.8"],"size":"45324675"},{"id":"sha256:6417e1437b6d9a789e1ca789695a574e1df00a632bdbfbcae9695c9a7d500e32","repoDigests":["registry.k8s.io/kube-apiserver@sha256:c47449f3e751588ea0cb74e325e0f83db335a415f4f4c7fb147375dd6c84757f"],"repoTags":["registry.k8s.io/kube-apiserver:v1.32.2"],"size":"26215036"},{"id":"sha256:3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"249461"},{"id":"sha256:e1181ee320546c66f17956a302db1b7899d88a593f116726718851133de588b6","repoDigests":["docker.io/kindest/kindnetd@sha256:56ea59f77258052c4506076525318ffa66817500f68e94a50fdf7d600a280d26"],"repoTags":["docker.io/kindest/kindnetd:v20241212-9f82dd49"],"size":"35679862"},{"id":"sha256:ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c3
48c33fbcde6","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"8034419"},{"id":"sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8","repoDigests":["registry.k8s.io/pause@sha256:ee6521f290b2168b6e0935a181d4cff9be1ac3f505666ef0e3c98fae8199917a"],"repoTags":["registry.k8s.io/pause:3.10"],"size":"267933"},{"id":"sha256:8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"71300"},{"id":"sha256:a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a","repoDigests":["docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"],"repoTags":[],"size":"18306114"},{"id":"sha256:2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4","repoDigests":["registry.k8s.io/coredns/coredns@sha256:9caabbf6238b189a65d0
d6e6ac138de60d6a1c419e5a341fbbb7c78382559c6e"],"repoTags":["registry.k8s.io/coredns/coredns:v1.11.3"],"size":"16948420"},{"id":"sha256:7fc9d4aa817aa6a3e549f3cd49d1f7b496407be979fc36dd5f356d59ce8c3a82","repoDigests":["registry.k8s.io/etcd@sha256:c6a9d11cc5c04b114ccdef39a9265eeef818e3d02f5359be035ae784097fdec5"],"repoTags":["registry.k8s.io/etcd:3.5.16-0"],"size":"67941650"},{"id":"sha256:3c9285acfd2ff7915bb451cc40ac060366ac519f3fef00c455f5aca0e0346c4d","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:399aa50f4d1361c59dc458e634506d02de32613d03a9a614a21058741162ef90"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.32.2"],"size":"23968941"},{"id":"sha256:ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17","repoDigests":[],"repoTags":["docker.io/kicbase/echo-server:functional-068510"],"size":"2173567"},{"id":"sha256:20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8","repoDigests":["docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d
65b24f588b1d449841ef93"],"repoTags":[],"size":"74084559"},{"id":"sha256:1530d85bdba64a05d90f5ed988c8f77ccf2cc8582027f3ad8a7c5b39a5c5e22b","repoDigests":["docker.io/library/nginx@sha256:09369da6b10306312cd908661320086bf87fbae1b6b0c49a1f50ba531fef2eab"],"repoTags":["docker.io/library/nginx:latest"],"size":"68655620"},{"id":"sha256:e5aac5df76d9b8dc899ab8c4db25a7648e7fb25cafe7a155066247883c78f062","repoDigests":["registry.k8s.io/kube-proxy@sha256:83c025f0faa6799fab6645102a98138e39a9a7db2be3bc792c79d72659b1805d"],"repoTags":["registry.k8s.io/kube-proxy:v1.32.2"],"size":"27362401"},{"id":"sha256:82dfa03f692fb5d84f66c17d6ee9126b081182152b25d28ea456d89b7d5d8911","repoDigests":["registry.k8s.io/kube-scheduler@sha256:45710d74cfd5aa10a001d0cf81747b77c28617444ffee0503d12f1dcd7450f76"],"repoTags":["registry.k8s.io/kube-scheduler:v1.32.2"],"size":"18921614"},{"id":"sha256:8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"262191"}]
functional_test.go:286: (dbg) Stderr: out/minikube-linux-arm64 -p functional-068510 image ls --format json --alsologtostderr:
I0414 11:04:00.918644  639468 out.go:345] Setting OutFile to fd 1 ...
I0414 11:04:00.918834  639468 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 11:04:00.918860  639468 out.go:358] Setting ErrFile to fd 2...
I0414 11:04:00.918881  639468 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 11:04:00.919143  639468 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
I0414 11:04:00.919771  639468 config.go:182] Loaded profile config "functional-068510": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
I0414 11:04:00.919953  639468 config.go:182] Loaded profile config "functional-068510": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
I0414 11:04:00.920494  639468 cli_runner.go:164] Run: docker container inspect functional-068510 --format={{.State.Status}}
I0414 11:04:00.938968  639468 ssh_runner.go:195] Run: systemctl --version
I0414 11:04:00.939015  639468 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-068510
I0414 11:04:00.958702  639468 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33525 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/functional-068510/id_rsa Username:docker}
I0414 11:04:01.050371  639468 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:278: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image ls --format yaml --alsologtostderr
functional_test.go:283: (dbg) Stdout: out/minikube-linux-arm64 -p functional-068510 image ls --format yaml --alsologtostderr:
- id: sha256:8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "262191"
- id: sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8
repoDigests:
- registry.k8s.io/pause@sha256:ee6521f290b2168b6e0935a181d4cff9be1ac3f505666ef0e3c98fae8199917a
repoTags:
- registry.k8s.io/pause:3.10
size: "267933"
- id: sha256:e1181ee320546c66f17956a302db1b7899d88a593f116726718851133de588b6
repoDigests:
- docker.io/kindest/kindnetd@sha256:56ea59f77258052c4506076525318ffa66817500f68e94a50fdf7d600a280d26
repoTags:
- docker.io/kindest/kindnetd:v20241212-9f82dd49
size: "35679862"
- id: sha256:20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8
repoDigests:
- docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93
repoTags: []
size: "74084559"
- id: sha256:3c9285acfd2ff7915bb451cc40ac060366ac519f3fef00c455f5aca0e0346c4d
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:399aa50f4d1361c59dc458e634506d02de32613d03a9a614a21058741162ef90
repoTags:
- registry.k8s.io/kube-controller-manager:v1.32.2
size: "23968941"
- id: sha256:82dfa03f692fb5d84f66c17d6ee9126b081182152b25d28ea456d89b7d5d8911
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:45710d74cfd5aa10a001d0cf81747b77c28617444ffee0503d12f1dcd7450f76
repoTags:
- registry.k8s.io/kube-scheduler:v1.32.2
size: "18921614"
- id: sha256:3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "249461"
- id: sha256:ee75e27fff91c8d59835f9a3efdf968ff404e580bad69746a65bcf3e304ab26f
repoDigests:
- docker.io/kindest/kindnetd@sha256:e3c42406b0806c1f7e8a66838377936cbd2cdfd94d9b26a3eefedada8713d495
repoTags:
- docker.io/kindest/kindnetd:v20250214-acbabc1a
size: "35677907"
- id: sha256:a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a
repoDigests:
- docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c
repoTags: []
size: "18306114"
- id: sha256:1530d85bdba64a05d90f5ed988c8f77ccf2cc8582027f3ad8a7c5b39a5c5e22b
repoDigests:
- docker.io/library/nginx@sha256:09369da6b10306312cd908661320086bf87fbae1b6b0c49a1f50ba531fef2eab
repoTags:
- docker.io/library/nginx:latest
size: "68655620"
- id: sha256:1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "1935750"
- id: sha256:2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:9caabbf6238b189a65d0d6e6ac138de60d6a1c419e5a341fbbb7c78382559c6e
repoTags:
- registry.k8s.io/coredns/coredns:v1.11.3
size: "16948420"
- id: sha256:ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17
repoDigests: []
repoTags:
- docker.io/kicbase/echo-server:functional-068510
size: "2173567"
- id: sha256:72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests:
- registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "45324675"
- id: sha256:7fc9d4aa817aa6a3e549f3cd49d1f7b496407be979fc36dd5f356d59ce8c3a82
repoDigests:
- registry.k8s.io/etcd@sha256:c6a9d11cc5c04b114ccdef39a9265eeef818e3d02f5359be035ae784097fdec5
repoTags:
- registry.k8s.io/etcd:3.5.16-0
size: "67941650"
- id: sha256:6417e1437b6d9a789e1ca789695a574e1df00a632bdbfbcae9695c9a7d500e32
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:c47449f3e751588ea0cb74e325e0f83db335a415f4f4c7fb147375dd6c84757f
repoTags:
- registry.k8s.io/kube-apiserver:v1.32.2
size: "26215036"
- id: sha256:e5aac5df76d9b8dc899ab8c4db25a7648e7fb25cafe7a155066247883c78f062
repoDigests:
- registry.k8s.io/kube-proxy@sha256:83c025f0faa6799fab6645102a98138e39a9a7db2be3bc792c79d72659b1805d
repoTags:
- registry.k8s.io/kube-proxy:v1.32.2
size: "27362401"
- id: sha256:8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "71300"
- id: sha256:1ac5ce6345e439b7c7033cc7e8fca9183da03eb998e46486f7530f655a139a0b
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-068510
size: "992"
- id: sha256:cedb667e1a7b4e6d843a4f74f1f2db0dac1c29b43978aa72dbae2193e3b8eea3
repoDigests:
- docker.io/library/nginx@sha256:4ff102c5d78d254a6f0da062b3cf39eaf07f01eec0927fd21e219d0af8bc0591
repoTags:
- docker.io/library/nginx:alpine
size: "21684747"
- id: sha256:ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "8034419"

                                                
                                                
functional_test.go:286: (dbg) Stderr: out/minikube-linux-arm64 -p functional-068510 image ls --format yaml --alsologtostderr:
I0414 11:04:00.533733  639389 out.go:345] Setting OutFile to fd 1 ...
I0414 11:04:00.533959  639389 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 11:04:00.533986  639389 out.go:358] Setting ErrFile to fd 2...
I0414 11:04:00.534007  639389 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 11:04:00.534287  639389 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
I0414 11:04:00.534895  639389 config.go:182] Loaded profile config "functional-068510": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
I0414 11:04:00.535072  639389 config.go:182] Loaded profile config "functional-068510": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
I0414 11:04:00.535528  639389 cli_runner.go:164] Run: docker container inspect functional-068510 --format={{.State.Status}}
I0414 11:04:00.553954  639389 ssh_runner.go:195] Run: systemctl --version
I0414 11:04:00.554006  639389 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-068510
I0414 11:04:00.577373  639389 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33525 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/functional-068510/id_rsa Username:docker}
I0414 11:04:00.666213  639389 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (3.87s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 ssh pgrep buildkitd
functional_test.go:325: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-068510 ssh pgrep buildkitd: exit status 1 (317.329625ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:332: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image build -t localhost/my-image:functional-068510 testdata/build --alsologtostderr
functional_test.go:332: (dbg) Done: out/minikube-linux-arm64 -p functional-068510 image build -t localhost/my-image:functional-068510 testdata/build --alsologtostderr: (3.32926032s)
functional_test.go:340: (dbg) Stderr: out/minikube-linux-arm64 -p functional-068510 image build -t localhost/my-image:functional-068510 testdata/build --alsologtostderr:
I0414 11:04:01.107960  639518 out.go:345] Setting OutFile to fd 1 ...
I0414 11:04:01.108775  639518 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 11:04:01.108815  639518 out.go:358] Setting ErrFile to fd 2...
I0414 11:04:01.108834  639518 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0414 11:04:01.109179  639518 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
I0414 11:04:01.110088  639518 config.go:182] Loaded profile config "functional-068510": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
I0414 11:04:01.111610  639518 config.go:182] Loaded profile config "functional-068510": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
I0414 11:04:01.112083  639518 cli_runner.go:164] Run: docker container inspect functional-068510 --format={{.State.Status}}
I0414 11:04:01.152479  639518 ssh_runner.go:195] Run: systemctl --version
I0414 11:04:01.152529  639518 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-068510
I0414 11:04:01.189181  639518 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33525 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/functional-068510/id_rsa Username:docker}
I0414 11:04:01.290125  639518 build_images.go:161] Building image from path: /tmp/build.332557794.tar
I0414 11:04:01.290199  639518 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0414 11:04:01.300438  639518 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.332557794.tar
I0414 11:04:01.303625  639518 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.332557794.tar: stat -c "%s %y" /var/lib/minikube/build/build.332557794.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.332557794.tar': No such file or directory
I0414 11:04:01.303650  639518 ssh_runner.go:362] scp /tmp/build.332557794.tar --> /var/lib/minikube/build/build.332557794.tar (3072 bytes)
I0414 11:04:01.330985  639518 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.332557794
I0414 11:04:01.341646  639518 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.332557794 -xf /var/lib/minikube/build/build.332557794.tar
I0414 11:04:01.352415  639518 containerd.go:394] Building image: /var/lib/minikube/build/build.332557794
I0414 11:04:01.352492  639518 ssh_runner.go:195] Run: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.332557794 --local dockerfile=/var/lib/minikube/build/build.332557794 --output type=image,name=localhost/my-image:functional-068510
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 97B done
#1 DONE 0.0s

                                                
                                                
#2 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#2 DONE 1.4s

                                                
                                                
#3 [internal] load .dockerignore
#3 transferring context: 2B done
#3 DONE 0.0s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox:latest@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox:latest@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 DONE 0.1s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox:latest@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0B / 828.50kB 0.2s
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.3s done
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0.1s done
#5 DONE 0.5s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 0.6s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.0s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.1s done
#8 exporting manifest sha256:cff22b60a11b347134a28d66c6d4fd2c1c8b435c76b97905ddb984c4a3242834 0.0s done
#8 exporting config sha256:0c4d1e0d770d0488fdc90a8d1d3891f7c3a420a4f024645cfe27d5ba75d35aae 0.0s done
#8 naming to localhost/my-image:functional-068510 done
#8 DONE 0.2s
I0414 11:04:04.337543  639518 ssh_runner.go:235] Completed: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.332557794 --local dockerfile=/var/lib/minikube/build/build.332557794 --output type=image,name=localhost/my-image:functional-068510: (2.985027042s)
I0414 11:04:04.337602  639518 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.332557794
I0414 11:04:04.347164  639518 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.332557794.tar
I0414 11:04:04.356084  639518 build_images.go:217] Built localhost/my-image:functional-068510 from /tmp/build.332557794.tar
I0414 11:04:04.356113  639518 build_images.go:133] succeeded building to: functional-068510
I0414 11:04:04.356119  639518 build_images.go:134] failed building to: 
functional_test.go:468: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (3.87s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (0.72s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:359: (dbg) Run:  docker pull kicbase/echo-server:1.0
functional_test.go:364: (dbg) Run:  docker tag kicbase/echo-server:1.0 kicbase/echo-server:functional-068510
--- PASS: TestFunctional/parallel/ImageCommands/Setup (0.72s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:372: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image load --daemon kicbase/echo-server:functional-068510 --alsologtostderr
functional_test.go:468: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.15s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:382: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image load --daemon kicbase/echo-server:functional-068510 --alsologtostderr
functional_test.go:468: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.07s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:252: (dbg) Run:  docker pull kicbase/echo-server:latest
functional_test.go:257: (dbg) Run:  docker tag kicbase/echo-server:latest kicbase/echo-server:functional-068510
functional_test.go:262: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image load --daemon kicbase/echo-server:functional-068510 --alsologtostderr
2025/04/14 11:03:56 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
functional_test.go:468: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.41s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2136: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.21s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.17s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2136: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.17s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2136: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.16s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.43s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:397: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image save kicbase/echo-server:functional-068510 /home/jenkins/workspace/Docker_Linux_containerd_arm64/echo-server-save.tar --alsologtostderr
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.43s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.62s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:409: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image rm kicbase/echo-server:functional-068510 --alsologtostderr
functional_test.go:468: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.62s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.87s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:426: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image load /home/jenkins/workspace/Docker_Linux_containerd_arm64/echo-server-save.tar --alsologtostderr
functional_test.go:468: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.87s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:436: (dbg) Run:  docker rmi kicbase/echo-server:functional-068510
functional_test.go:441: (dbg) Run:  out/minikube-linux-arm64 -p functional-068510 image save --daemon kicbase/echo-server:functional-068510 --alsologtostderr
functional_test.go:449: (dbg) Run:  docker image inspect kicbase/echo-server:functional-068510
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.51s)

                                                
                                    
x
+
TestFunctional/delete_echo-server_images (0.04s)

                                                
                                                
=== RUN   TestFunctional/delete_echo-server_images
functional_test.go:207: (dbg) Run:  docker rmi -f kicbase/echo-server:1.0
functional_test.go:207: (dbg) Run:  docker rmi -f kicbase/echo-server:functional-068510
--- PASS: TestFunctional/delete_echo-server_images (0.04s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:215: (dbg) Run:  docker rmi -f localhost/my-image:functional-068510
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:223: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-068510
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StartCluster (121.96s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run:  out/minikube-linux-arm64 start -p ha-176405 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd
E0414 11:04:29.845901  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:101: (dbg) Done: out/minikube-linux-arm64 start -p ha-176405 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd: (2m1.191273745s)
ha_test.go:107: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 status -v=7 --alsologtostderr
--- PASS: TestMultiControlPlane/serial/StartCluster (121.96s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeployApp (31.49s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:133: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- rollout status deployment/busybox
ha_test.go:133: (dbg) Done: out/minikube-linux-arm64 kubectl -p ha-176405 -- rollout status deployment/busybox: (28.647471263s)
ha_test.go:140: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:163: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- exec busybox-58667487b6-d59pp -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- exec busybox-58667487b6-hggw9 -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- exec busybox-58667487b6-pkh65 -- nslookup kubernetes.io
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- exec busybox-58667487b6-d59pp -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- exec busybox-58667487b6-hggw9 -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- exec busybox-58667487b6-pkh65 -- nslookup kubernetes.default
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- exec busybox-58667487b6-d59pp -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- exec busybox-58667487b6-hggw9 -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- exec busybox-58667487b6-pkh65 -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiControlPlane/serial/DeployApp (31.49s)

                                                
                                    
x
+
TestMultiControlPlane/serial/PingHostFromPods (1.59s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- exec busybox-58667487b6-d59pp -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- exec busybox-58667487b6-d59pp -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- exec busybox-58667487b6-hggw9 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- exec busybox-58667487b6-hggw9 -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- exec busybox-58667487b6-pkh65 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-176405 -- exec busybox-58667487b6-pkh65 -- sh -c "ping -c 1 192.168.49.1"
--- PASS: TestMultiControlPlane/serial/PingHostFromPods (1.59s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddWorkerNode (24.02s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run:  out/minikube-linux-arm64 node add -p ha-176405 -v=7 --alsologtostderr
E0414 11:06:45.981067  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:228: (dbg) Done: out/minikube-linux-arm64 node add -p ha-176405 -v=7 --alsologtostderr: (23.069846802s)
ha_test.go:234: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 status -v=7 --alsologtostderr
--- PASS: TestMultiControlPlane/serial/AddWorkerNode (24.02s)

                                                
                                    
x
+
TestMultiControlPlane/serial/NodeLabels (0.1s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run:  kubectl --context ha-176405 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiControlPlane/serial/NodeLabels (0.10s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterClusterStart (0.94s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterClusterStart (0.94s)

                                                
                                    
x
+
TestMultiControlPlane/serial/CopyFile (18.26s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/CopyFile
ha_test.go:328: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 status --output json -v=7 --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp testdata/cp-test.txt ha-176405:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile2124713952/001/cp-test_ha-176405.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405:/home/docker/cp-test.txt ha-176405-m02:/home/docker/cp-test_ha-176405_ha-176405-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m02 "sudo cat /home/docker/cp-test_ha-176405_ha-176405-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405:/home/docker/cp-test.txt ha-176405-m03:/home/docker/cp-test_ha-176405_ha-176405-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m03 "sudo cat /home/docker/cp-test_ha-176405_ha-176405-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405:/home/docker/cp-test.txt ha-176405-m04:/home/docker/cp-test_ha-176405_ha-176405-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m04 "sudo cat /home/docker/cp-test_ha-176405_ha-176405-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp testdata/cp-test.txt ha-176405-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405-m02:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile2124713952/001/cp-test_ha-176405-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m02 "sudo cat /home/docker/cp-test.txt"
E0414 11:07:13.687978  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405-m02:/home/docker/cp-test.txt ha-176405:/home/docker/cp-test_ha-176405-m02_ha-176405.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405 "sudo cat /home/docker/cp-test_ha-176405-m02_ha-176405.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405-m02:/home/docker/cp-test.txt ha-176405-m03:/home/docker/cp-test_ha-176405-m02_ha-176405-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m03 "sudo cat /home/docker/cp-test_ha-176405-m02_ha-176405-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405-m02:/home/docker/cp-test.txt ha-176405-m04:/home/docker/cp-test_ha-176405-m02_ha-176405-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m04 "sudo cat /home/docker/cp-test_ha-176405-m02_ha-176405-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp testdata/cp-test.txt ha-176405-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405-m03:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile2124713952/001/cp-test_ha-176405-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405-m03:/home/docker/cp-test.txt ha-176405:/home/docker/cp-test_ha-176405-m03_ha-176405.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405 "sudo cat /home/docker/cp-test_ha-176405-m03_ha-176405.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405-m03:/home/docker/cp-test.txt ha-176405-m02:/home/docker/cp-test_ha-176405-m03_ha-176405-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m02 "sudo cat /home/docker/cp-test_ha-176405-m03_ha-176405-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405-m03:/home/docker/cp-test.txt ha-176405-m04:/home/docker/cp-test_ha-176405-m03_ha-176405-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m04 "sudo cat /home/docker/cp-test_ha-176405-m03_ha-176405-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp testdata/cp-test.txt ha-176405-m04:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile2124713952/001/cp-test_ha-176405-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405-m04:/home/docker/cp-test.txt ha-176405:/home/docker/cp-test_ha-176405-m04_ha-176405.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405 "sudo cat /home/docker/cp-test_ha-176405-m04_ha-176405.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405-m04:/home/docker/cp-test.txt ha-176405-m02:/home/docker/cp-test_ha-176405-m04_ha-176405-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m02 "sudo cat /home/docker/cp-test_ha-176405-m04_ha-176405-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 cp ha-176405-m04:/home/docker/cp-test.txt ha-176405-m03:/home/docker/cp-test_ha-176405-m04_ha-176405-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 ssh -n ha-176405-m03 "sudo cat /home/docker/cp-test_ha-176405-m04_ha-176405-m03.txt"
--- PASS: TestMultiControlPlane/serial/CopyFile (18.26s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopSecondaryNode (12.7s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopSecondaryNode
ha_test.go:365: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 node stop m02 -v=7 --alsologtostderr
ha_test.go:365: (dbg) Done: out/minikube-linux-arm64 -p ha-176405 node stop m02 -v=7 --alsologtostderr: (11.99940658s)
ha_test.go:371: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 status -v=7 --alsologtostderr
ha_test.go:371: (dbg) Non-zero exit: out/minikube-linux-arm64 -p ha-176405 status -v=7 --alsologtostderr: exit status 7 (704.739886ms)

                                                
                                                
-- stdout --
	ha-176405
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-176405-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-176405-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-176405-m04
	type: Worker
	host: Running
	kubelet: Running
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0414 11:07:37.828672  656247 out.go:345] Setting OutFile to fd 1 ...
	I0414 11:07:37.828902  656247 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:07:37.828934  656247 out.go:358] Setting ErrFile to fd 2...
	I0414 11:07:37.828958  656247 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:07:37.829281  656247 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
	I0414 11:07:37.829543  656247 out.go:352] Setting JSON to false
	I0414 11:07:37.829610  656247 mustload.go:65] Loading cluster: ha-176405
	I0414 11:07:37.829841  656247 notify.go:220] Checking for updates...
	I0414 11:07:37.830777  656247 config.go:182] Loaded profile config "ha-176405": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
	I0414 11:07:37.830829  656247 status.go:174] checking status of ha-176405 ...
	I0414 11:07:37.832340  656247 cli_runner.go:164] Run: docker container inspect ha-176405 --format={{.State.Status}}
	I0414 11:07:37.852643  656247 status.go:371] ha-176405 host status = "Running" (err=<nil>)
	I0414 11:07:37.852665  656247 host.go:66] Checking if "ha-176405" exists ...
	I0414 11:07:37.852948  656247 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-176405
	I0414 11:07:37.870746  656247 host.go:66] Checking if "ha-176405" exists ...
	I0414 11:07:37.871053  656247 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0414 11:07:37.871101  656247 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-176405
	I0414 11:07:37.894381  656247 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33530 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/ha-176405/id_rsa Username:docker}
	I0414 11:07:37.987756  656247 ssh_runner.go:195] Run: systemctl --version
	I0414 11:07:37.992698  656247 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0414 11:07:38.004613  656247 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0414 11:07:38.066705  656247 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:69 OomKillDisable:true NGoroutines:72 SystemTime:2025-04-14 11:07:38.054737146 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1081-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0]] Warnings:<nil>}}
	I0414 11:07:38.067262  656247 kubeconfig.go:125] found "ha-176405" server: "https://192.168.49.254:8443"
	I0414 11:07:38.067301  656247 api_server.go:166] Checking apiserver status ...
	I0414 11:07:38.067349  656247 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0414 11:07:38.078487  656247 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1475/cgroup
	I0414 11:07:38.087869  656247 api_server.go:182] apiserver freezer: "7:freezer:/docker/f003f5a5d172e89cbb1060071aaa17d902a2e7df56be28e3f72f40a6d9984526/kubepods/burstable/pod4ce45ea8e7a2d6cf40775d4fe3ab904f/e1f67ecdc08ea601a97a699a09760e31163db7d0fb8976e378ece4e11ebe2785"
	I0414 11:07:38.087938  656247 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/f003f5a5d172e89cbb1060071aaa17d902a2e7df56be28e3f72f40a6d9984526/kubepods/burstable/pod4ce45ea8e7a2d6cf40775d4fe3ab904f/e1f67ecdc08ea601a97a699a09760e31163db7d0fb8976e378ece4e11ebe2785/freezer.state
	I0414 11:07:38.097385  656247 api_server.go:204] freezer state: "THAWED"
	I0414 11:07:38.097418  656247 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0414 11:07:38.104983  656247 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0414 11:07:38.105017  656247 status.go:463] ha-176405 apiserver status = Running (err=<nil>)
	I0414 11:07:38.105031  656247 status.go:176] ha-176405 status: &{Name:ha-176405 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0414 11:07:38.105071  656247 status.go:174] checking status of ha-176405-m02 ...
	I0414 11:07:38.105400  656247 cli_runner.go:164] Run: docker container inspect ha-176405-m02 --format={{.State.Status}}
	I0414 11:07:38.123169  656247 status.go:371] ha-176405-m02 host status = "Stopped" (err=<nil>)
	I0414 11:07:38.123187  656247 status.go:384] host is not running, skipping remaining checks
	I0414 11:07:38.123194  656247 status.go:176] ha-176405-m02 status: &{Name:ha-176405-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0414 11:07:38.123214  656247 status.go:174] checking status of ha-176405-m03 ...
	I0414 11:07:38.123505  656247 cli_runner.go:164] Run: docker container inspect ha-176405-m03 --format={{.State.Status}}
	I0414 11:07:38.142615  656247 status.go:371] ha-176405-m03 host status = "Running" (err=<nil>)
	I0414 11:07:38.142641  656247 host.go:66] Checking if "ha-176405-m03" exists ...
	I0414 11:07:38.142950  656247 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-176405-m03
	I0414 11:07:38.163169  656247 host.go:66] Checking if "ha-176405-m03" exists ...
	I0414 11:07:38.163478  656247 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0414 11:07:38.163521  656247 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-176405-m03
	I0414 11:07:38.181156  656247 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33540 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/ha-176405-m03/id_rsa Username:docker}
	I0414 11:07:38.270700  656247 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0414 11:07:38.282870  656247 kubeconfig.go:125] found "ha-176405" server: "https://192.168.49.254:8443"
	I0414 11:07:38.282897  656247 api_server.go:166] Checking apiserver status ...
	I0414 11:07:38.282940  656247 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0414 11:07:38.294668  656247 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1442/cgroup
	I0414 11:07:38.303937  656247 api_server.go:182] apiserver freezer: "7:freezer:/docker/6654d8bc1300d0f2e46b1f7adad60639c9bc593830a383bec9d6230363f1d246/kubepods/burstable/podf56cfea49ac2d6feaa3d97f1df42b6f5/cb57e8a0806e5f853a490ebb58b1c6672abab4b29dc0eee88ef1a3cc24be90e0"
	I0414 11:07:38.304044  656247 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/6654d8bc1300d0f2e46b1f7adad60639c9bc593830a383bec9d6230363f1d246/kubepods/burstable/podf56cfea49ac2d6feaa3d97f1df42b6f5/cb57e8a0806e5f853a490ebb58b1c6672abab4b29dc0eee88ef1a3cc24be90e0/freezer.state
	I0414 11:07:38.312718  656247 api_server.go:204] freezer state: "THAWED"
	I0414 11:07:38.312748  656247 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0414 11:07:38.320433  656247 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0414 11:07:38.320460  656247 status.go:463] ha-176405-m03 apiserver status = Running (err=<nil>)
	I0414 11:07:38.320471  656247 status.go:176] ha-176405-m03 status: &{Name:ha-176405-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0414 11:07:38.320487  656247 status.go:174] checking status of ha-176405-m04 ...
	I0414 11:07:38.320783  656247 cli_runner.go:164] Run: docker container inspect ha-176405-m04 --format={{.State.Status}}
	I0414 11:07:38.337300  656247 status.go:371] ha-176405-m04 host status = "Running" (err=<nil>)
	I0414 11:07:38.337325  656247 host.go:66] Checking if "ha-176405-m04" exists ...
	I0414 11:07:38.337632  656247 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-176405-m04
	I0414 11:07:38.356603  656247 host.go:66] Checking if "ha-176405-m04" exists ...
	I0414 11:07:38.356969  656247 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0414 11:07:38.357026  656247 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-176405-m04
	I0414 11:07:38.378335  656247 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33545 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/ha-176405-m04/id_rsa Username:docker}
	I0414 11:07:38.471295  656247 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0414 11:07:38.481993  656247 status.go:176] ha-176405-m04 status: &{Name:ha-176405-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopSecondaryNode (12.70s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.75s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:392: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.75s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartSecondaryNode (18.92s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode
ha_test.go:422: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 node start m02 -v=7 --alsologtostderr
ha_test.go:422: (dbg) Done: out/minikube-linux-arm64 -p ha-176405 node start m02 -v=7 --alsologtostderr: (17.888149575s)
ha_test.go:430: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 status -v=7 --alsologtostderr
ha_test.go:450: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiControlPlane/serial/RestartSecondaryNode (18.92s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (1s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
ha_test.go:281: (dbg) Done: out/minikube-linux-arm64 profile list --output json: (1.000610038s)
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (1.00s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartClusterKeepsNodes (134.03s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:458: (dbg) Run:  out/minikube-linux-arm64 node list -p ha-176405 -v=7 --alsologtostderr
ha_test.go:464: (dbg) Run:  out/minikube-linux-arm64 stop -p ha-176405 -v=7 --alsologtostderr
E0414 11:08:14.057977  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:08:14.064389  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:08:14.075740  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:08:14.097107  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:08:14.138469  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:08:14.220060  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:08:14.381600  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:08:14.703284  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:08:15.345297  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:08:16.626633  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:08:19.188085  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:08:24.309887  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:08:34.551966  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:464: (dbg) Done: out/minikube-linux-arm64 stop -p ha-176405 -v=7 --alsologtostderr: (37.083792688s)
ha_test.go:469: (dbg) Run:  out/minikube-linux-arm64 start -p ha-176405 --wait=true -v=7 --alsologtostderr
E0414 11:08:55.033512  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:09:35.995266  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:469: (dbg) Done: out/minikube-linux-arm64 start -p ha-176405 --wait=true -v=7 --alsologtostderr: (1m36.786666806s)
ha_test.go:474: (dbg) Run:  out/minikube-linux-arm64 node list -p ha-176405
--- PASS: TestMultiControlPlane/serial/RestartClusterKeepsNodes (134.03s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeleteSecondaryNode (10.4s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode
ha_test.go:489: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 node delete m03 -v=7 --alsologtostderr
ha_test.go:489: (dbg) Done: out/minikube-linux-arm64 -p ha-176405 node delete m03 -v=7 --alsologtostderr: (9.477373272s)
ha_test.go:495: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 status -v=7 --alsologtostderr
ha_test.go:513: (dbg) Run:  kubectl get nodes
ha_test.go:521: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/DeleteSecondaryNode (10.40s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.74s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:392: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.74s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopCluster (35.84s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopCluster
ha_test.go:533: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 stop -v=7 --alsologtostderr
E0414 11:10:57.917914  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:533: (dbg) Done: out/minikube-linux-arm64 -p ha-176405 stop -v=7 --alsologtostderr: (35.726115546s)
ha_test.go:539: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 status -v=7 --alsologtostderr
ha_test.go:539: (dbg) Non-zero exit: out/minikube-linux-arm64 -p ha-176405 status -v=7 --alsologtostderr: exit status 7 (114.229899ms)

                                                
                                                
-- stdout --
	ha-176405
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-176405-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-176405-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0414 11:11:00.109478  671147 out.go:345] Setting OutFile to fd 1 ...
	I0414 11:11:00.109615  671147 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:11:00.109624  671147 out.go:358] Setting ErrFile to fd 2...
	I0414 11:11:00.109628  671147 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:11:00.109920  671147 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
	I0414 11:11:00.110115  671147 out.go:352] Setting JSON to false
	I0414 11:11:00.110151  671147 mustload.go:65] Loading cluster: ha-176405
	I0414 11:11:00.110567  671147 config.go:182] Loaded profile config "ha-176405": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
	I0414 11:11:00.110589  671147 status.go:174] checking status of ha-176405 ...
	I0414 11:11:00.111115  671147 cli_runner.go:164] Run: docker container inspect ha-176405 --format={{.State.Status}}
	I0414 11:11:00.111435  671147 notify.go:220] Checking for updates...
	I0414 11:11:00.131774  671147 status.go:371] ha-176405 host status = "Stopped" (err=<nil>)
	I0414 11:11:00.131798  671147 status.go:384] host is not running, skipping remaining checks
	I0414 11:11:00.131805  671147 status.go:176] ha-176405 status: &{Name:ha-176405 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0414 11:11:00.131840  671147 status.go:174] checking status of ha-176405-m02 ...
	I0414 11:11:00.132137  671147 cli_runner.go:164] Run: docker container inspect ha-176405-m02 --format={{.State.Status}}
	I0414 11:11:00.151768  671147 status.go:371] ha-176405-m02 host status = "Stopped" (err=<nil>)
	I0414 11:11:00.151792  671147 status.go:384] host is not running, skipping remaining checks
	I0414 11:11:00.151798  671147 status.go:176] ha-176405-m02 status: &{Name:ha-176405-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0414 11:11:00.151817  671147 status.go:174] checking status of ha-176405-m04 ...
	I0414 11:11:00.152098  671147 cli_runner.go:164] Run: docker container inspect ha-176405-m04 --format={{.State.Status}}
	I0414 11:11:00.174148  671147 status.go:371] ha-176405-m04 host status = "Stopped" (err=<nil>)
	I0414 11:11:00.174167  671147 status.go:384] host is not running, skipping remaining checks
	I0414 11:11:00.174174  671147 status.go:176] ha-176405-m04 status: &{Name:ha-176405-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopCluster (35.84s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartCluster (74.3s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartCluster
ha_test.go:562: (dbg) Run:  out/minikube-linux-arm64 start -p ha-176405 --wait=true -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd
E0414 11:11:45.980782  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
ha_test.go:562: (dbg) Done: out/minikube-linux-arm64 start -p ha-176405 --wait=true -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m13.348783161s)
ha_test.go:568: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 status -v=7 --alsologtostderr
ha_test.go:586: (dbg) Run:  kubectl get nodes
ha_test.go:594: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/RestartCluster (74.30s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.73s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:392: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.73s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddSecondaryNode (40.45s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddSecondaryNode
ha_test.go:607: (dbg) Run:  out/minikube-linux-arm64 node add -p ha-176405 --control-plane -v=7 --alsologtostderr
ha_test.go:607: (dbg) Done: out/minikube-linux-arm64 node add -p ha-176405 --control-plane -v=7 --alsologtostderr: (39.478300235s)
ha_test.go:613: (dbg) Run:  out/minikube-linux-arm64 -p ha-176405 status -v=7 --alsologtostderr
--- PASS: TestMultiControlPlane/serial/AddSecondaryNode (40.45s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.98s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.98s)

                                                
                                    
x
+
TestJSONOutput/start/Command (59.09s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-076386 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd
E0414 11:13:14.057858  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:13:41.759255  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 start -p json-output-076386 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd: (59.077853534s)
--- PASS: TestJSONOutput/start/Command (59.09s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.76s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 pause -p json-output-076386 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.76s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.62s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 unpause -p json-output-076386 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.62s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.74s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 stop -p json-output-076386 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 stop -p json-output-076386 --output=json --user=testUser: (5.738316879s)
--- PASS: TestJSONOutput/stop/Command (5.74s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.24s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-error-801364 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p json-output-error-801364 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (91.352675ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"10cbbc27-307c-493a-b6d3-7f030ba5b1b3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-801364] minikube v1.35.0 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"52980ab8-57c5-4e81-a278-4a0f32ac205f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=20534"}}
	{"specversion":"1.0","id":"3058d546-b6d5-41bc-9cf8-1bfb654ada84","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"30aefc81-efa5-4ccd-a42a-76087b977945","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig"}}
	{"specversion":"1.0","id":"2d130f93-aa90-45cd-a9c9-b6db5204e145","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube"}}
	{"specversion":"1.0","id":"7687f24b-5d07-4570-acdd-47dc5f32a427","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"5fdc7e02-17e1-4339-80e1-5e25bc43e10f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"edf42156-e1be-42b4-9ca1-4cd216385a06","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-801364" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p json-output-error-801364
--- PASS: TestErrorJSONOutput (0.24s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (39.45s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-827670 --network=
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-827670 --network=: (37.29566135s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-827670" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-827670
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-827670: (2.128022354s)
--- PASS: TestKicCustomNetwork/create_custom_network (39.45s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (33.53s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-243218 --network=bridge
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-243218 --network=bridge: (31.537675307s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-243218" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-243218
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-243218: (1.965474083s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (33.53s)

                                                
                                    
x
+
TestKicExistingNetwork (33.36s)

                                                
                                                
=== RUN   TestKicExistingNetwork
I0414 11:15:28.109611  600227 cli_runner.go:164] Run: docker network inspect existing-network --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0414 11:15:28.125819  600227 cli_runner.go:211] docker network inspect existing-network --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0414 11:15:28.126512  600227 network_create.go:284] running [docker network inspect existing-network] to gather additional debugging logs...
I0414 11:15:28.126984  600227 cli_runner.go:164] Run: docker network inspect existing-network
W0414 11:15:28.143519  600227 cli_runner.go:211] docker network inspect existing-network returned with exit code 1
I0414 11:15:28.143547  600227 network_create.go:287] error running [docker network inspect existing-network]: docker network inspect existing-network: exit status 1
stdout:
[]

                                                
                                                
stderr:
Error response from daemon: network existing-network not found
I0414 11:15:28.143563  600227 network_create.go:289] output of [docker network inspect existing-network]: -- stdout --
[]

                                                
                                                
-- /stdout --
** stderr ** 
Error response from daemon: network existing-network not found

                                                
                                                
** /stderr **
I0414 11:15:28.145264  600227 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0414 11:15:28.161885  600227 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-da2afc92daab IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:ee:7f:23:65:0d:d3} reservation:<nil>}
I0414 11:15:28.166320  600227 network.go:209] skipping subnet 192.168.58.0/24 that is reserved: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0414 11:15:28.166627  600227 network.go:206] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001919670}
I0414 11:15:28.167127  600227 network_create.go:124] attempt to create docker network existing-network 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
I0414 11:15:28.167189  600227 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=existing-network existing-network
I0414 11:15:28.228312  600227 network_create.go:108] docker network existing-network 192.168.67.0/24 created
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-arm64 start -p existing-network-333132 --network=existing-network
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-arm64 start -p existing-network-333132 --network=existing-network: (31.199761676s)
helpers_test.go:175: Cleaning up "existing-network-333132" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p existing-network-333132
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p existing-network-333132: (2.007606639s)
I0414 11:16:01.451978  600227 cli_runner.go:164] Run: docker network ls --filter=label=existing-network --format {{.Name}}
--- PASS: TestKicExistingNetwork (33.36s)

                                                
                                    
x
+
TestKicCustomSubnet (34.63s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-subnet-319725 --subnet=192.168.60.0/24
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-subnet-319725 --subnet=192.168.60.0/24: (32.532269459s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-319725 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-319725" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p custom-subnet-319725
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p custom-subnet-319725: (2.067190353s)
--- PASS: TestKicCustomSubnet (34.63s)

                                                
                                    
x
+
TestKicStaticIP (32.96s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-arm64 start -p static-ip-501005 --static-ip=192.168.200.200
E0414 11:16:45.981094  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-arm64 start -p static-ip-501005 --static-ip=192.168.200.200: (30.680677318s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-arm64 -p static-ip-501005 ip
helpers_test.go:175: Cleaning up "static-ip-501005" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p static-ip-501005
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p static-ip-501005: (2.110084477s)
--- PASS: TestKicStaticIP (32.96s)

                                                
                                    
x
+
TestMainNoArgs (0.06s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-arm64
--- PASS: TestMainNoArgs (0.06s)

                                                
                                    
x
+
TestMinikubeProfile (67.08s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p first-742427 --driver=docker  --container-runtime=containerd
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p first-742427 --driver=docker  --container-runtime=containerd: (31.252628492s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p second-745315 --driver=docker  --container-runtime=containerd
E0414 11:18:09.052514  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p second-745315 --driver=docker  --container-runtime=containerd: (30.333532267s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile first-742427
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile second-745315
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
helpers_test.go:175: Cleaning up "second-745315" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p second-745315
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p second-745315: (1.938168286s)
helpers_test.go:175: Cleaning up "first-742427" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p first-742427
E0414 11:18:14.057698  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p first-742427: (2.250661245s)
--- PASS: TestMinikubeProfile (67.08s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (8.63s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-1-168512 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-1-168512 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (7.630372714s)
--- PASS: TestMountStart/serial/StartWithMountFirst (8.63s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.24s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-1-168512 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.24s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (8.73s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-170399 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-170399 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (7.730626896s)
--- PASS: TestMountStart/serial/StartWithMountSecond (8.73s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.26s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-170399 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.26s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.6s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p mount-start-1-168512 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p mount-start-1-168512 --alsologtostderr -v=5: (1.59492428s)
--- PASS: TestMountStart/serial/DeleteFirst (1.60s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.25s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-170399 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.25s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.19s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-arm64 stop -p mount-start-2-170399
mount_start_test.go:155: (dbg) Done: out/minikube-linux-arm64 stop -p mount-start-2-170399: (1.194499951s)
--- PASS: TestMountStart/serial/Stop (1.19s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (7.12s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-170399
mount_start_test.go:166: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-170399: (6.121547386s)
--- PASS: TestMountStart/serial/RestartStopped (7.12s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.26s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-170399 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.26s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (75.21s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-559279 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
multinode_test.go:96: (dbg) Done: out/minikube-linux-arm64 start -p multinode-559279 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m14.697467064s)
multinode_test.go:102: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (75.21s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (15.97s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-559279 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:498: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-559279 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-559279 -- rollout status deployment/busybox: (13.918586225s)
multinode_test.go:505: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-559279 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:528: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-559279 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:536: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-559279 -- exec busybox-58667487b6-6mhcc -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-559279 -- exec busybox-58667487b6-wrh6r -- nslookup kubernetes.io
multinode_test.go:546: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-559279 -- exec busybox-58667487b6-6mhcc -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-559279 -- exec busybox-58667487b6-wrh6r -- nslookup kubernetes.default
multinode_test.go:554: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-559279 -- exec busybox-58667487b6-6mhcc -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-559279 -- exec busybox-58667487b6-wrh6r -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (15.97s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (1.03s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-559279 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:572: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-559279 -- exec busybox-58667487b6-6mhcc -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-559279 -- exec busybox-58667487b6-6mhcc -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:572: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-559279 -- exec busybox-58667487b6-wrh6r -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-559279 -- exec busybox-58667487b6-wrh6r -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (1.03s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (19.71s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-559279 -v 3 --alsologtostderr
multinode_test.go:121: (dbg) Done: out/minikube-linux-arm64 node add -p multinode-559279 -v 3 --alsologtostderr: (19.072637962s)
multinode_test.go:127: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (19.71s)

                                                
                                    
x
+
TestMultiNode/serial/MultiNodeLabels (0.09s)

                                                
                                                
=== RUN   TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run:  kubectl --context multinode-559279 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiNode/serial/MultiNodeLabels (0.09s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.67s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.67s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (9.57s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 cp testdata/cp-test.txt multinode-559279:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 cp multinode-559279:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile3836324853/001/cp-test_multinode-559279.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 cp multinode-559279:/home/docker/cp-test.txt multinode-559279-m02:/home/docker/cp-test_multinode-559279_multinode-559279-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279-m02 "sudo cat /home/docker/cp-test_multinode-559279_multinode-559279-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 cp multinode-559279:/home/docker/cp-test.txt multinode-559279-m03:/home/docker/cp-test_multinode-559279_multinode-559279-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279-m03 "sudo cat /home/docker/cp-test_multinode-559279_multinode-559279-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 cp testdata/cp-test.txt multinode-559279-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 cp multinode-559279-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile3836324853/001/cp-test_multinode-559279-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 cp multinode-559279-m02:/home/docker/cp-test.txt multinode-559279:/home/docker/cp-test_multinode-559279-m02_multinode-559279.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279 "sudo cat /home/docker/cp-test_multinode-559279-m02_multinode-559279.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 cp multinode-559279-m02:/home/docker/cp-test.txt multinode-559279-m03:/home/docker/cp-test_multinode-559279-m02_multinode-559279-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279-m03 "sudo cat /home/docker/cp-test_multinode-559279-m02_multinode-559279-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 cp testdata/cp-test.txt multinode-559279-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 cp multinode-559279-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile3836324853/001/cp-test_multinode-559279-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 cp multinode-559279-m03:/home/docker/cp-test.txt multinode-559279:/home/docker/cp-test_multinode-559279-m03_multinode-559279.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279 "sudo cat /home/docker/cp-test_multinode-559279-m03_multinode-559279.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 cp multinode-559279-m03:/home/docker/cp-test.txt multinode-559279-m02:/home/docker/cp-test_multinode-559279-m03_multinode-559279-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 ssh -n multinode-559279-m02 "sudo cat /home/docker/cp-test_multinode-559279-m03_multinode-559279-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (9.57s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.17s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 node stop m03
multinode_test.go:248: (dbg) Done: out/minikube-linux-arm64 -p multinode-559279 node stop m03: (1.193230436s)
multinode_test.go:254: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-559279 status: exit status 7 (474.370955ms)

                                                
                                                
-- stdout --
	multinode-559279
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-559279-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-559279-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-559279 status --alsologtostderr: exit status 7 (506.869182ms)

                                                
                                                
-- stdout --
	multinode-559279
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-559279-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-559279-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0414 11:20:50.182899  726528 out.go:345] Setting OutFile to fd 1 ...
	I0414 11:20:50.183052  726528 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:20:50.183061  726528 out.go:358] Setting ErrFile to fd 2...
	I0414 11:20:50.183065  726528 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:20:50.183306  726528 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
	I0414 11:20:50.183486  726528 out.go:352] Setting JSON to false
	I0414 11:20:50.183525  726528 mustload.go:65] Loading cluster: multinode-559279
	I0414 11:20:50.183592  726528 notify.go:220] Checking for updates...
	I0414 11:20:50.184812  726528 config.go:182] Loaded profile config "multinode-559279": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
	I0414 11:20:50.184843  726528 status.go:174] checking status of multinode-559279 ...
	I0414 11:20:50.185342  726528 cli_runner.go:164] Run: docker container inspect multinode-559279 --format={{.State.Status}}
	I0414 11:20:50.208971  726528 status.go:371] multinode-559279 host status = "Running" (err=<nil>)
	I0414 11:20:50.208994  726528 host.go:66] Checking if "multinode-559279" exists ...
	I0414 11:20:50.209278  726528 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-559279
	I0414 11:20:50.235726  726528 host.go:66] Checking if "multinode-559279" exists ...
	I0414 11:20:50.236002  726528 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0414 11:20:50.236049  726528 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-559279
	I0414 11:20:50.254052  726528 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33651 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/multinode-559279/id_rsa Username:docker}
	I0414 11:20:50.342789  726528 ssh_runner.go:195] Run: systemctl --version
	I0414 11:20:50.346733  726528 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0414 11:20:50.357728  726528 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0414 11:20:50.414552  726528 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:50 OomKillDisable:true NGoroutines:62 SystemTime:2025-04-14 11:20:50.404808929 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1081-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0]] Warnings:<nil>}}
	I0414 11:20:50.415152  726528 kubeconfig.go:125] found "multinode-559279" server: "https://192.168.58.2:8443"
	I0414 11:20:50.415189  726528 api_server.go:166] Checking apiserver status ...
	I0414 11:20:50.415238  726528 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0414 11:20:50.426362  726528 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1421/cgroup
	I0414 11:20:50.440911  726528 api_server.go:182] apiserver freezer: "7:freezer:/docker/07a86e6903d65c0c5132fccf865031cd9c3e4e71e8319f853bf27ac6d74f3251/kubepods/burstable/podcf9d79c61059a433abc7147cd86a27de/f629275987603ab5bb697e01613673f356c1715b3ea3ac19dcd2cdd4a9c0562f"
	I0414 11:20:50.440977  726528 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/07a86e6903d65c0c5132fccf865031cd9c3e4e71e8319f853bf27ac6d74f3251/kubepods/burstable/podcf9d79c61059a433abc7147cd86a27de/f629275987603ab5bb697e01613673f356c1715b3ea3ac19dcd2cdd4a9c0562f/freezer.state
	I0414 11:20:50.450446  726528 api_server.go:204] freezer state: "THAWED"
	I0414 11:20:50.450470  726528 api_server.go:253] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I0414 11:20:50.458730  726528 api_server.go:279] https://192.168.58.2:8443/healthz returned 200:
	ok
	I0414 11:20:50.458757  726528 status.go:463] multinode-559279 apiserver status = Running (err=<nil>)
	I0414 11:20:50.458768  726528 status.go:176] multinode-559279 status: &{Name:multinode-559279 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0414 11:20:50.458788  726528 status.go:174] checking status of multinode-559279-m02 ...
	I0414 11:20:50.459081  726528 cli_runner.go:164] Run: docker container inspect multinode-559279-m02 --format={{.State.Status}}
	I0414 11:20:50.475119  726528 status.go:371] multinode-559279-m02 host status = "Running" (err=<nil>)
	I0414 11:20:50.475141  726528 host.go:66] Checking if "multinode-559279-m02" exists ...
	I0414 11:20:50.475471  726528 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-559279-m02
	I0414 11:20:50.491663  726528 host.go:66] Checking if "multinode-559279-m02" exists ...
	I0414 11:20:50.491946  726528 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0414 11:20:50.491983  726528 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-559279-m02
	I0414 11:20:50.510758  726528 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33656 SSHKeyPath:/home/jenkins/minikube-integration/20534-594855/.minikube/machines/multinode-559279-m02/id_rsa Username:docker}
	I0414 11:20:50.598641  726528 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0414 11:20:50.610705  726528 status.go:176] multinode-559279-m02 status: &{Name:multinode-559279-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0414 11:20:50.610736  726528 status.go:174] checking status of multinode-559279-m03 ...
	I0414 11:20:50.611052  726528 cli_runner.go:164] Run: docker container inspect multinode-559279-m03 --format={{.State.Status}}
	I0414 11:20:50.628430  726528 status.go:371] multinode-559279-m03 host status = "Stopped" (err=<nil>)
	I0414 11:20:50.628455  726528 status.go:384] host is not running, skipping remaining checks
	I0414 11:20:50.628463  726528 status.go:176] multinode-559279-m03 status: &{Name:multinode-559279-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.17s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (9.51s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 node start m03 -v=7 --alsologtostderr
multinode_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p multinode-559279 node start m03 -v=7 --alsologtostderr: (8.763482105s)
multinode_test.go:290: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 status -v=7 --alsologtostderr
multinode_test.go:306: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (9.51s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (80.17s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-559279
multinode_test.go:321: (dbg) Run:  out/minikube-linux-arm64 stop -p multinode-559279
multinode_test.go:321: (dbg) Done: out/minikube-linux-arm64 stop -p multinode-559279: (24.842970103s)
multinode_test.go:326: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-559279 --wait=true -v=8 --alsologtostderr
E0414 11:21:45.980749  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
multinode_test.go:326: (dbg) Done: out/minikube-linux-arm64 start -p multinode-559279 --wait=true -v=8 --alsologtostderr: (55.20328872s)
multinode_test.go:331: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-559279
--- PASS: TestMultiNode/serial/RestartKeepsNodes (80.17s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.26s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 node delete m03
multinode_test.go:416: (dbg) Done: out/minikube-linux-arm64 -p multinode-559279 node delete m03: (4.633999048s)
multinode_test.go:422: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 status --alsologtostderr
multinode_test.go:436: (dbg) Run:  kubectl get nodes
multinode_test.go:444: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.26s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (23.88s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 stop
multinode_test.go:345: (dbg) Done: out/minikube-linux-arm64 -p multinode-559279 stop: (23.683996857s)
multinode_test.go:351: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-559279 status: exit status 7 (100.01372ms)

                                                
                                                
-- stdout --
	multinode-559279
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-559279-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:358: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-559279 status --alsologtostderr: exit status 7 (95.412032ms)

                                                
                                                
-- stdout --
	multinode-559279
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-559279-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0414 11:22:49.410232  734995 out.go:345] Setting OutFile to fd 1 ...
	I0414 11:22:49.410457  734995 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:22:49.410485  734995 out.go:358] Setting ErrFile to fd 2...
	I0414 11:22:49.410503  734995 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:22:49.410807  734995 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
	I0414 11:22:49.411032  734995 out.go:352] Setting JSON to false
	I0414 11:22:49.411094  734995 mustload.go:65] Loading cluster: multinode-559279
	I0414 11:22:49.411170  734995 notify.go:220] Checking for updates...
	I0414 11:22:49.411563  734995 config.go:182] Loaded profile config "multinode-559279": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
	I0414 11:22:49.411603  734995 status.go:174] checking status of multinode-559279 ...
	I0414 11:22:49.412399  734995 cli_runner.go:164] Run: docker container inspect multinode-559279 --format={{.State.Status}}
	I0414 11:22:49.430160  734995 status.go:371] multinode-559279 host status = "Stopped" (err=<nil>)
	I0414 11:22:49.430183  734995 status.go:384] host is not running, skipping remaining checks
	I0414 11:22:49.430191  734995 status.go:176] multinode-559279 status: &{Name:multinode-559279 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0414 11:22:49.430221  734995 status.go:174] checking status of multinode-559279-m02 ...
	I0414 11:22:49.430516  734995 cli_runner.go:164] Run: docker container inspect multinode-559279-m02 --format={{.State.Status}}
	I0414 11:22:49.449907  734995 status.go:371] multinode-559279-m02 host status = "Stopped" (err=<nil>)
	I0414 11:22:49.449930  734995 status.go:384] host is not running, skipping remaining checks
	I0414 11:22:49.449938  734995 status.go:176] multinode-559279-m02 status: &{Name:multinode-559279-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (23.88s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (50.95s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-559279 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
E0414 11:23:14.058162  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
multinode_test.go:376: (dbg) Done: out/minikube-linux-arm64 start -p multinode-559279 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (50.30135829s)
multinode_test.go:382: (dbg) Run:  out/minikube-linux-arm64 -p multinode-559279 status --alsologtostderr
multinode_test.go:396: (dbg) Run:  kubectl get nodes
multinode_test.go:404: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (50.95s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (30.04s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-559279
multinode_test.go:464: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-559279-m02 --driver=docker  --container-runtime=containerd
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p multinode-559279-m02 --driver=docker  --container-runtime=containerd: exit status 14 (92.884178ms)

                                                
                                                
-- stdout --
	* [multinode-559279-m02] minikube v1.35.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=20534
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-559279-m02' is duplicated with machine name 'multinode-559279-m02' in profile 'multinode-559279'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-559279-m03 --driver=docker  --container-runtime=containerd
multinode_test.go:472: (dbg) Done: out/minikube-linux-arm64 start -p multinode-559279-m03 --driver=docker  --container-runtime=containerd: (27.63058517s)
multinode_test.go:479: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-559279
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-linux-arm64 node add -p multinode-559279: exit status 80 (323.635274ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-559279 as [worker]
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-559279-m03 already exists in multinode-559279-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:484: (dbg) Run:  out/minikube-linux-arm64 delete -p multinode-559279-m03
multinode_test.go:484: (dbg) Done: out/minikube-linux-arm64 delete -p multinode-559279-m03: (1.948631232s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (30.04s)

                                                
                                    
x
+
TestPreload (122.64s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-505300 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4
E0414 11:24:37.120594  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
preload_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-505300 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4: (1m23.765905108s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-505300 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-arm64 -p test-preload-505300 image pull gcr.io/k8s-minikube/busybox: (2.135182268s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-arm64 stop -p test-preload-505300
preload_test.go:58: (dbg) Done: out/minikube-linux-arm64 stop -p test-preload-505300: (12.047291882s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-505300 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd
preload_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-505300 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd: (21.849729581s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-505300 image list
helpers_test.go:175: Cleaning up "test-preload-505300" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p test-preload-505300
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p test-preload-505300: (2.518536417s)
--- PASS: TestPreload (122.64s)

                                                
                                    
x
+
TestScheduledStopUnix (108.07s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-arm64 start -p scheduled-stop-321927 --memory=2048 --driver=docker  --container-runtime=containerd
E0414 11:26:45.981175  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-321927 --memory=2048 --driver=docker  --container-runtime=containerd: (32.206680191s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-321927 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-321927 -n scheduled-stop-321927
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-321927 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
I0414 11:26:49.780092  600227 retry.go:31] will retry after 66.118µs: open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/scheduled-stop-321927/pid: no such file or directory
I0414 11:26:49.781170  600227 retry.go:31] will retry after 172.48µs: open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/scheduled-stop-321927/pid: no such file or directory
I0414 11:26:49.782314  600227 retry.go:31] will retry after 333.592µs: open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/scheduled-stop-321927/pid: no such file or directory
I0414 11:26:49.783453  600227 retry.go:31] will retry after 183.075µs: open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/scheduled-stop-321927/pid: no such file or directory
I0414 11:26:49.784577  600227 retry.go:31] will retry after 597.518µs: open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/scheduled-stop-321927/pid: no such file or directory
I0414 11:26:49.785663  600227 retry.go:31] will retry after 548.99µs: open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/scheduled-stop-321927/pid: no such file or directory
I0414 11:26:49.786772  600227 retry.go:31] will retry after 1.128641ms: open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/scheduled-stop-321927/pid: no such file or directory
I0414 11:26:49.788949  600227 retry.go:31] will retry after 1.663865ms: open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/scheduled-stop-321927/pid: no such file or directory
I0414 11:26:49.791117  600227 retry.go:31] will retry after 3.629802ms: open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/scheduled-stop-321927/pid: no such file or directory
I0414 11:26:49.795305  600227 retry.go:31] will retry after 2.781362ms: open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/scheduled-stop-321927/pid: no such file or directory
I0414 11:26:49.798541  600227 retry.go:31] will retry after 5.806086ms: open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/scheduled-stop-321927/pid: no such file or directory
I0414 11:26:49.805833  600227 retry.go:31] will retry after 5.671747ms: open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/scheduled-stop-321927/pid: no such file or directory
I0414 11:26:49.812022  600227 retry.go:31] will retry after 15.636643ms: open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/scheduled-stop-321927/pid: no such file or directory
I0414 11:26:49.828251  600227 retry.go:31] will retry after 25.044997ms: open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/scheduled-stop-321927/pid: no such file or directory
I0414 11:26:49.853415  600227 retry.go:31] will retry after 36.922567ms: open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/scheduled-stop-321927/pid: no such file or directory
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-321927 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-321927 -n scheduled-stop-321927
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-321927
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-321927 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-321927
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p scheduled-stop-321927: exit status 7 (75.869053ms)

                                                
                                                
-- stdout --
	scheduled-stop-321927
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-321927 -n scheduled-stop-321927
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-321927 -n scheduled-stop-321927: exit status 7 (75.503862ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-321927" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p scheduled-stop-321927
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-321927: (4.339888235s)
--- PASS: TestScheduledStopUnix (108.07s)

                                                
                                    
x
+
TestInsufficientStorage (10.5s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-arm64 start -p insufficient-storage-421835 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p insufficient-storage-421835 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd: exit status 26 (8.071204429s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"0cb6afb2-069d-449d-9663-cc696502d13a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-421835] minikube v1.35.0 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"e5d58547-4d9d-412f-b814-cb4eef953375","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=20534"}}
	{"specversion":"1.0","id":"d087ae8b-b096-4702-b1df-3d88bbb2d87b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"c6ee0e04-f551-489e-b8d0-8d0b66fe8dfc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig"}}
	{"specversion":"1.0","id":"385f2b0e-a055-4eda-946a-950e118c2a6d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube"}}
	{"specversion":"1.0","id":"65eec586-dfd1-460d-aea1-fc14c1d334a9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"19055eb3-0f6b-4e37-b6e9-bf0154458795","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"1da24b18-9706-4ca5-9220-5c7b86174a23","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"1e400298-6576-470f-896b-d15f426cd325","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"934792db-551a-41b5-8d6d-794aa4f65a17","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"8f559678-f5e6-4cd7-8939-3ffc05148712","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"28a4c94d-a21e-45de-addc-05c2198d991d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"insufficient-storage-421835\" primary control-plane node in \"insufficient-storage-421835\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"d79c867f-5cfb-41fd-9f94-9d6b0d86da7a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image v0.0.46-1744107393-20604 ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"bfad82df-32c7-4d43-b19a-9e1b8f2cbce3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"3118a8f5-265b-4824-be09-d134c56e742e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-421835 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-421835 --output=json --layout=cluster: exit status 7 (273.245206ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-421835","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.35.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-421835","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0414 11:28:13.490170  754087 status.go:458] kubeconfig endpoint: get endpoint: "insufficient-storage-421835" does not appear in /home/jenkins/minikube-integration/20534-594855/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-421835 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-421835 --output=json --layout=cluster: exit status 7 (279.304877ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-421835","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.35.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-421835","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0414 11:28:13.769930  754148 status.go:458] kubeconfig endpoint: get endpoint: "insufficient-storage-421835" does not appear in /home/jenkins/minikube-integration/20534-594855/kubeconfig
	E0414 11:28:13.779621  754148 status.go:258] unable to read event log: stat: stat /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/insufficient-storage-421835/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-421835" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p insufficient-storage-421835
E0414 11:28:14.057918  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p insufficient-storage-421835: (1.878765582s)
--- PASS: TestInsufficientStorage (10.50s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (84.78s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run:  /tmp/minikube-v1.26.0.3154844548 start -p running-upgrade-116495 --memory=2200 --vm-driver=docker  --container-runtime=containerd
E0414 11:31:45.981151  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
version_upgrade_test.go:120: (dbg) Done: /tmp/minikube-v1.26.0.3154844548 start -p running-upgrade-116495 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (40.993031266s)
version_upgrade_test.go:130: (dbg) Run:  out/minikube-linux-arm64 start -p running-upgrade-116495 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:130: (dbg) Done: out/minikube-linux-arm64 start -p running-upgrade-116495 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (39.34231284s)
helpers_test.go:175: Cleaning up "running-upgrade-116495" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p running-upgrade-116495
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p running-upgrade-116495: (3.371652655s)
--- PASS: TestRunningBinaryUpgrade (84.78s)

                                                
                                    
x
+
TestKubernetesUpgrade (105.43s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-873215 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:222: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-873215 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m2.127160821s)
version_upgrade_test.go:227: (dbg) Run:  out/minikube-linux-arm64 stop -p kubernetes-upgrade-873215
version_upgrade_test.go:227: (dbg) Done: out/minikube-linux-arm64 stop -p kubernetes-upgrade-873215: (1.651901003s)
version_upgrade_test.go:232: (dbg) Run:  out/minikube-linux-arm64 -p kubernetes-upgrade-873215 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-linux-arm64 -p kubernetes-upgrade-873215 status --format={{.Host}}: exit status 7 (86.387212ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-873215 --memory=2200 --kubernetes-version=v1.32.2 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:243: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-873215 --memory=2200 --kubernetes-version=v1.32.2 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (29.325993396s)
version_upgrade_test.go:248: (dbg) Run:  kubectl --context kubernetes-upgrade-873215 version --output=json
version_upgrade_test.go:267: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:269: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-873215 --memory=2200 --kubernetes-version=v1.20.0 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:269: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p kubernetes-upgrade-873215 --memory=2200 --kubernetes-version=v1.20.0 --driver=docker  --container-runtime=containerd: exit status 106 (143.249589ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-873215] minikube v1.35.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=20534
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.32.2 cluster to v1.20.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.20.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-873215
	    minikube start -p kubernetes-upgrade-873215 --kubernetes-version=v1.20.0
	    
	    2) Create a second cluster with Kubernetes 1.20.0, by running:
	    
	    minikube start -p kubernetes-upgrade-8732152 --kubernetes-version=v1.20.0
	    
	    3) Use the existing cluster at version Kubernetes 1.32.2, by running:
	    
	    minikube start -p kubernetes-upgrade-873215 --kubernetes-version=v1.32.2
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:273: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:275: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-873215 --memory=2200 --kubernetes-version=v1.32.2 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:275: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-873215 --memory=2200 --kubernetes-version=v1.32.2 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (9.549090841s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-873215" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubernetes-upgrade-873215
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p kubernetes-upgrade-873215: (2.423596888s)
--- PASS: TestKubernetesUpgrade (105.43s)

                                                
                                    
x
+
TestMissingContainerUpgrade (181.48s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:309: (dbg) Run:  /tmp/minikube-v1.26.0.2824888710 start -p missing-upgrade-834259 --memory=2200 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:309: (dbg) Done: /tmp/minikube-v1.26.0.2824888710 start -p missing-upgrade-834259 --memory=2200 --driver=docker  --container-runtime=containerd: (1m38.621227114s)
version_upgrade_test.go:318: (dbg) Run:  docker stop missing-upgrade-834259
version_upgrade_test.go:318: (dbg) Done: docker stop missing-upgrade-834259: (10.405504136s)
version_upgrade_test.go:323: (dbg) Run:  docker rm missing-upgrade-834259
version_upgrade_test.go:329: (dbg) Run:  out/minikube-linux-arm64 start -p missing-upgrade-834259 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:329: (dbg) Done: out/minikube-linux-arm64 start -p missing-upgrade-834259 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m6.29725348s)
helpers_test.go:175: Cleaning up "missing-upgrade-834259" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p missing-upgrade-834259
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p missing-upgrade-834259: (4.907647095s)
--- PASS: TestMissingContainerUpgrade (181.48s)

                                                
                                    
x
+
TestPause/serial/Start (55.07s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-arm64 start -p pause-572231 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd
pause_test.go:80: (dbg) Done: out/minikube-linux-arm64 start -p pause-572231 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd: (55.064542733s)
--- PASS: TestPause/serial/Start (55.07s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (7.16s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-arm64 start -p pause-572231 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
pause_test.go:92: (dbg) Done: out/minikube-linux-arm64 start -p pause-572231 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (7.142744127s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (7.16s)

                                                
                                    
x
+
TestPause/serial/Pause (0.7s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-572231 --alsologtostderr -v=5
--- PASS: TestPause/serial/Pause (0.70s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.32s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p pause-572231 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p pause-572231 --output=json --layout=cluster: exit status 2 (317.63973ms)

                                                
                                                
-- stdout --
	{"Name":"pause-572231","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 7 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.35.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-572231","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.32s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.65s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-arm64 unpause -p pause-572231 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.65s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (0.81s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-572231 --alsologtostderr -v=5
--- PASS: TestPause/serial/PauseAgain (0.81s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (2.51s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p pause-572231 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p pause-572231 --alsologtostderr -v=5: (2.510959829s)
--- PASS: TestPause/serial/DeletePaused (2.51s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.38s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-572231
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-572231: exit status 1 (16.299939ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-572231: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (0.38s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (1s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (1.00s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (173.89s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run:  /tmp/minikube-v1.26.0.3818764540 start -p stopped-upgrade-304423 --memory=2200 --vm-driver=docker  --container-runtime=containerd
version_upgrade_test.go:183: (dbg) Done: /tmp/minikube-v1.26.0.3818764540 start -p stopped-upgrade-304423 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (41.571239707s)
version_upgrade_test.go:192: (dbg) Run:  /tmp/minikube-v1.26.0.3818764540 -p stopped-upgrade-304423 stop
version_upgrade_test.go:192: (dbg) Done: /tmp/minikube-v1.26.0.3818764540 -p stopped-upgrade-304423 stop: (20.11400411s)
version_upgrade_test.go:198: (dbg) Run:  out/minikube-linux-arm64 start -p stopped-upgrade-304423 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:198: (dbg) Done: out/minikube-linux-arm64 start -p stopped-upgrade-304423 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m52.207719765s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (173.89s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.09s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-646025 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p NoKubernetes-646025 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd: exit status 14 (89.242987ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-646025] minikube v1.35.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=20534
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.09s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (34s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-646025 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-646025 --driver=docker  --container-runtime=containerd: (33.645712652s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-646025 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (34.00s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (16.83s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-646025 --no-kubernetes --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-646025 --no-kubernetes --driver=docker  --container-runtime=containerd: (14.363715017s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-646025 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-arm64 -p NoKubernetes-646025 status -o json: exit status 2 (364.831617ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-646025","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-arm64 delete -p NoKubernetes-646025
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-arm64 delete -p NoKubernetes-646025: (2.101558783s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (16.83s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (1.09s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run:  out/minikube-linux-arm64 logs -p stopped-upgrade-304423
version_upgrade_test.go:206: (dbg) Done: out/minikube-linux-arm64 logs -p stopped-upgrade-304423: (1.090575568s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.09s)

                                                
                                    
x
+
TestNetworkPlugins/group/false (5.33s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false
net_test.go:246: (dbg) Run:  out/minikube-linux-arm64 start -p false-648814 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd
net_test.go:246: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p false-648814 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd: exit status 14 (225.717473ms)

                                                
                                                
-- stdout --
	* [false-648814] minikube v1.35.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=20534
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on user configuration
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0414 11:34:11.841390  787582 out.go:345] Setting OutFile to fd 1 ...
	I0414 11:34:11.841505  787582 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:34:11.841516  787582 out.go:358] Setting ErrFile to fd 2...
	I0414 11:34:11.841521  787582 out.go:392] TERM=,COLORTERM=, which probably does not support color
	I0414 11:34:11.841802  787582 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20534-594855/.minikube/bin
	I0414 11:34:11.842211  787582 out.go:352] Setting JSON to false
	I0414 11:34:11.843052  787582 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":11797,"bootTime":1744618655,"procs":161,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1081-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
	I0414 11:34:11.843117  787582 start.go:139] virtualization:  
	I0414 11:34:11.847541  787582 out.go:177] * [false-648814] minikube v1.35.0 on Ubuntu 20.04 (arm64)
	I0414 11:34:11.851415  787582 out.go:177]   - MINIKUBE_LOCATION=20534
	I0414 11:34:11.851501  787582 notify.go:220] Checking for updates...
	I0414 11:34:11.859985  787582 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0414 11:34:11.863422  787582 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/20534-594855/kubeconfig
	I0414 11:34:11.866666  787582 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20534-594855/.minikube
	I0414 11:34:11.870010  787582 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0414 11:34:11.873180  787582 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0414 11:34:11.876516  787582 config.go:182] Loaded profile config "NoKubernetes-646025": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v0.0.0
	I0414 11:34:11.876673  787582 driver.go:394] Setting default libvirt URI to qemu:///system
	I0414 11:34:11.913403  787582 docker.go:123] docker version: linux-28.0.4:Docker Engine - Community
	I0414 11:34:11.913512  787582 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0414 11:34:11.986356  787582 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:true NGoroutines:42 SystemTime:2025-04-14 11:34:11.974035177 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1081-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0]] Warnings:<nil>}}
	I0414 11:34:11.986467  787582 docker.go:318] overlay module found
	I0414 11:34:11.989919  787582 out.go:177] * Using the docker driver based on user configuration
	I0414 11:34:11.992968  787582 start.go:297] selected driver: docker
	I0414 11:34:11.992985  787582 start.go:901] validating driver "docker" against <nil>
	I0414 11:34:11.992998  787582 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0414 11:34:11.996659  787582 out.go:201] 
	W0414 11:34:11.999616  787582 out.go:270] X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	I0414 11:34:12.002551  787582 out.go:201] 

                                                
                                                
** /stderr **
net_test.go:88: 
----------------------- debugLogs start: false-648814 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: false-648814

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: false-648814

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: false-648814

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: false-648814

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: false-648814

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: false-648814

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: false-648814

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: false-648814

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: false-648814

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: false-648814

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: false-648814

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "false-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "false-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "false-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "false-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "false-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "false-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "false-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "false-648814" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "false-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "false-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "false-648814" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: false-648814

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "false-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-648814"

                                                
                                                
----------------------- debugLogs end: false-648814 [took: 4.905794369s] --------------------------------
helpers_test.go:175: Cleaning up "false-648814" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p false-648814
--- PASS: TestNetworkPlugins/group/false (5.33s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (7.73s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-646025 --no-kubernetes --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-646025 --no-kubernetes --driver=docker  --container-runtime=containerd: (7.731194772s)
--- PASS: TestNoKubernetes/serial/Start (7.73s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.33s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-646025 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-646025 "sudo systemctl is-active --quiet service kubelet": exit status 1 (332.795635ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.33s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (0.8s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (0.80s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.26s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-arm64 stop -p NoKubernetes-646025
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-arm64 stop -p NoKubernetes-646025: (1.256437691s)
--- PASS: TestNoKubernetes/serial/Stop (1.26s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (6.87s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-646025 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-646025 --driver=docker  --container-runtime=containerd: (6.869707925s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (6.87s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.53s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-646025 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-646025 "sudo systemctl is-active --quiet service kubelet": exit status 1 (526.675394ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.53s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (157.14s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-943255 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0
E0414 11:36:45.981113  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-943255 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0: (2m37.141038484s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (157.14s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (75.8s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-391843 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2
E0414 11:38:14.058373  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-391843 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2: (1m15.80032491s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (75.80s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (8.85s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context old-k8s-version-943255 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [e9ad1ed0-cb22-462a-a9b9-988ea7c5140b] Pending
helpers_test.go:344: "busybox" [e9ad1ed0-cb22-462a-a9b9-988ea7c5140b] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [e9ad1ed0-cb22-462a-a9b9-988ea7c5140b] Running
start_stop_delete_test.go:194: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 8.007506202s
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context old-k8s-version-943255 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (8.85s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (2.08s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-943255 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:203: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-943255 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.842243305s)
start_stop_delete_test.go:213: (dbg) Run:  kubectl --context old-k8s-version-943255 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (2.08s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (12.4s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:226: (dbg) Run:  out/minikube-linux-arm64 stop -p old-k8s-version-943255 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-arm64 stop -p old-k8s-version-943255 --alsologtostderr -v=3: (12.397848289s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (12.40s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-943255 -n old-k8s-version-943255
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-943255 -n old-k8s-version-943255: exit status 7 (80.418568ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p old-k8s-version-943255 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.23s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (9.39s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context no-preload-391843 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [eabd7050-03f0-46eb-af5d-8e5ad82eb07b] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [eabd7050-03f0-46eb-af5d-8e5ad82eb07b] Running
start_stop_delete_test.go:194: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 9.008523832s
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context no-preload-391843 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (9.39s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.38s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p no-preload-391843 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:203: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p no-preload-391843 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.252973436s)
start_stop_delete_test.go:213: (dbg) Run:  kubectl --context no-preload-391843 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.38s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (11.98s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:226: (dbg) Run:  out/minikube-linux-arm64 stop -p no-preload-391843 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-arm64 stop -p no-preload-391843 --alsologtostderr -v=3: (11.97767385s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (11.98s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-391843 -n no-preload-391843
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-391843 -n no-preload-391843: exit status 7 (73.158744ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p no-preload-391843 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.19s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (266s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-391843 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2
E0414 11:41:17.121963  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:41:45.980893  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:43:14.058441  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-391843 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2: (4m25.61891076s)
start_stop_delete_test.go:260: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-391843 -n no-preload-391843
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (266.00s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-7779f9b69b-f477z" [0d34f7a5-676f-4469-b3dd-045ad4e7ced8] Running
start_stop_delete_test.go:272: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003077283s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6.00s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.12s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-7779f9b69b-f477z" [0d34f7a5-676f-4469-b3dd-045ad4e7ced8] Running
start_stop_delete_test.go:285: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.003796896s
start_stop_delete_test.go:289: (dbg) Run:  kubectl --context no-preload-391843 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.12s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.25s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run:  out/minikube-linux-arm64 -p no-preload-391843 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250214-acbabc1a
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.25s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (3.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 pause -p no-preload-391843 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-391843 -n no-preload-391843
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-391843 -n no-preload-391843: exit status 2 (321.585482ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-391843 -n no-preload-391843
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-391843 -n no-preload-391843: exit status 2 (318.866614ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 unpause -p no-preload-391843 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-391843 -n no-preload-391843
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-391843 -n no-preload-391843
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.07s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (52.16s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-680698 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-680698 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2: (52.162524002s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (52.16s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-cd95d586-xntzk" [e3eeb5f5-040c-4b5c-b254-088bec2e7088] Running
start_stop_delete_test.go:272: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.00429543s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.1s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-cd95d586-xntzk" [e3eeb5f5-040c-4b5c-b254-088bec2e7088] Running
start_stop_delete_test.go:285: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.004070097s
start_stop_delete_test.go:289: (dbg) Run:  kubectl --context old-k8s-version-943255 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.10s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.24s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run:  out/minikube-linux-arm64 -p old-k8s-version-943255 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20240202-8f1494ea
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250214-acbabc1a
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.24s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (2.89s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 pause -p old-k8s-version-943255 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-943255 -n old-k8s-version-943255
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-943255 -n old-k8s-version-943255: exit status 2 (326.567636ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-943255 -n old-k8s-version-943255
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-943255 -n old-k8s-version-943255: exit status 2 (320.405667ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 unpause -p old-k8s-version-943255 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-943255 -n old-k8s-version-943255
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-943255 -n old-k8s-version-943255
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (2.89s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (68.65s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-689364 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-689364 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2: (1m8.645011601s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (68.65s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (9.42s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context embed-certs-680698 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [632da180-7a6b-4078-b232-6da6b9b1b340] Pending
helpers_test.go:344: "busybox" [632da180-7a6b-4078-b232-6da6b9b1b340] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [632da180-7a6b-4078-b232-6da6b9b1b340] Running
start_stop_delete_test.go:194: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 9.005408289s
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context embed-certs-680698 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (9.42s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.63s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-680698 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:203: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-680698 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.440144454s)
start_stop_delete_test.go:213: (dbg) Run:  kubectl --context embed-certs-680698 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.63s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (12.31s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:226: (dbg) Run:  out/minikube-linux-arm64 stop -p embed-certs-680698 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-arm64 stop -p embed-certs-680698 --alsologtostderr -v=3: (12.311815753s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (12.31s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.35s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-680698 -n embed-certs-680698
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-680698 -n embed-certs-680698: exit status 7 (138.190701ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p embed-certs-680698 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.35s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (292.43s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-680698 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-680698 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2: (4m52.05926593s)
start_stop_delete_test.go:260: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-680698 -n embed-certs-680698
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (292.43s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (10.43s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context default-k8s-diff-port-689364 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [7d5aa627-9bf5-472f-8809-44f8528ca514] Pending
helpers_test.go:344: "busybox" [7d5aa627-9bf5-472f-8809-44f8528ca514] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [7d5aa627-9bf5-472f-8809-44f8528ca514] Running
start_stop_delete_test.go:194: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 10.003327344s
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context default-k8s-diff-port-689364 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (10.43s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.25s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-689364 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:203: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-689364 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.05099407s)
start_stop_delete_test.go:213: (dbg) Run:  kubectl --context default-k8s-diff-port-689364 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.25s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (12.11s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:226: (dbg) Run:  out/minikube-linux-arm64 stop -p default-k8s-diff-port-689364 --alsologtostderr -v=3
E0414 11:46:45.981141  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-arm64 stop -p default-k8s-diff-port-689364 --alsologtostderr -v=3: (12.109007013s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (12.11s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-689364 -n default-k8s-diff-port-689364
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-689364 -n default-k8s-diff-port-689364: exit status 7 (76.581589ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p default-k8s-diff-port-689364 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (268.79s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-689364 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2
E0414 11:48:14.057954  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:48:20.542409  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:48:20.548840  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:48:20.560250  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:48:20.581630  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:48:20.623694  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:48:20.705079  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:48:20.866966  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:48:21.188718  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:48:21.830176  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:48:23.111504  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:48:25.672851  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:48:30.794647  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:48:41.036438  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:49:01.517940  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:49:26.417270  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:49:26.423633  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:49:26.434997  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:49:26.456426  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:49:26.497884  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:49:26.579361  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:49:26.740965  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:49:27.062674  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:49:27.704042  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:49:28.985460  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:49:31.546790  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:49:36.668239  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:49:42.480499  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:49:46.909529  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:50:07.391148  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-689364 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2: (4m28.283691765s)
start_stop_delete_test.go:260: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-689364 -n default-k8s-diff-port-689364
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (268.79s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-7779f9b69b-pqxrg" [b6cc0fe6-085c-4a7f-8a24-983fc9aeea68] Running
start_stop_delete_test.go:272: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004337121s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.1s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-7779f9b69b-pqxrg" [b6cc0fe6-085c-4a7f-8a24-983fc9aeea68] Running
E0414 11:50:48.352601  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:285: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.004578634s
start_stop_delete_test.go:289: (dbg) Run:  kubectl --context embed-certs-680698 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.10s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.24s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run:  out/minikube-linux-arm64 -p embed-certs-680698 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20241212-9f82dd49
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250214-acbabc1a
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.24s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (3.22s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 pause -p embed-certs-680698 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-680698 -n embed-certs-680698
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-680698 -n embed-certs-680698: exit status 2 (327.128178ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-680698 -n embed-certs-680698
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-680698 -n embed-certs-680698: exit status 2 (339.943942ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 unpause -p embed-certs-680698 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-680698 -n embed-certs-680698
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-680698 -n embed-certs-680698
--- PASS: TestStartStop/group/embed-certs/serial/Pause (3.22s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (37.23s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-314073 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2
E0414 11:51:04.402266  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-314073 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2: (37.233290898s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (37.23s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-7779f9b69b-fg65q" [191bbda2-064b-4733-832f-2d2f64f7431d] Running
E0414 11:51:29.055620  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
start_stop_delete_test.go:272: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003998095s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.00s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (6.15s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-7779f9b69b-fg65q" [191bbda2-064b-4733-832f-2d2f64f7431d] Running
start_stop_delete_test.go:285: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003246739s
start_stop_delete_test.go:289: (dbg) Run:  kubectl --context default-k8s-diff-port-689364 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (6.15s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.45s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run:  out/minikube-linux-arm64 -p default-k8s-diff-port-689364 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250214-acbabc1a
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20241212-9f82dd49
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.45s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.5s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-314073 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:203: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-314073 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.498084617s)
start_stop_delete_test.go:209: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.50s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (4.27s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 pause -p default-k8s-diff-port-689364 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Done: out/minikube-linux-arm64 pause -p default-k8s-diff-port-689364 --alsologtostderr -v=1: (1.089303603s)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-689364 -n default-k8s-diff-port-689364
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-689364 -n default-k8s-diff-port-689364: exit status 2 (462.00853ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-689364 -n default-k8s-diff-port-689364
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-689364 -n default-k8s-diff-port-689364: exit status 2 (431.169396ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 unpause -p default-k8s-diff-port-689364 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-689364 -n default-k8s-diff-port-689364
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-689364 -n default-k8s-diff-port-689364
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (4.27s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (1.35s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:226: (dbg) Run:  out/minikube-linux-arm64 stop -p newest-cni-314073 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-arm64 stop -p newest-cni-314073 --alsologtostderr -v=3: (1.350983811s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (1.35s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.27s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-314073 -n newest-cni-314073
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-314073 -n newest-cni-314073: exit status 7 (121.720275ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p newest-cni-314073 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.27s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (20.52s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-314073 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-314073 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.32.2: (20.072068672s)
start_stop_delete_test.go:260: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-314073 -n newest-cni-314073
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (20.52s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (64.1s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p auto-648814 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd
E0414 11:51:45.980679  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p auto-648814 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd: (1m4.100868062s)
--- PASS: TestNetworkPlugins/group/auto/Start (64.10s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:271: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:282: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.25s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run:  out/minikube-linux-arm64 -p newest-cni-314073 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20241212-9f82dd49
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250214-acbabc1a
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.25s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (4.03s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 pause -p newest-cni-314073 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Done: out/minikube-linux-arm64 pause -p newest-cni-314073 --alsologtostderr -v=1: (1.315005829s)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-314073 -n newest-cni-314073
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-314073 -n newest-cni-314073: exit status 2 (399.48646ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-314073 -n newest-cni-314073
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-314073 -n newest-cni-314073: exit status 2 (437.631413ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 unpause -p newest-cni-314073 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-314073 -n newest-cni-314073
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-314073 -n newest-cni-314073
--- PASS: TestStartStop/group/newest-cni/serial/Pause (4.03s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (58.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kindnet-648814 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd
E0414 11:52:10.274020  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kindnet-648814 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd: (58.245460184s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (58.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p auto-648814 "pgrep -a kubelet"
I0414 11:52:48.221907  600227 config.go:182] Loaded profile config "auto-648814": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (9.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-648814 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-5d86dc444-swxxd" [9b06ffef-4cfe-49cd-9463-38de445cd82b] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-5d86dc444-swxxd" [9b06ffef-4cfe-49cd-9463-38de445cd82b] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 9.00425854s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (9.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-648814 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-648814 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-648814 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (6s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-b7cpg" [fc5da9b5-8c67-4a75-b09e-70ceec87c412] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 6.003730916s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (6.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.33s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kindnet-648814 "pgrep -a kubelet"
I0414 11:53:10.986789  600227 config.go:182] Loaded profile config "kindnet-648814": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.33s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (9.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-648814 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-5d86dc444-kmb4l" [bf8a9f22-3b0f-48ef-be8e-b1999f2f7384] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0414 11:53:14.058372  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:344: "netcat-5d86dc444-kmb4l" [bf8a9f22-3b0f-48ef-be8e-b1999f2f7384] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 9.005310414s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (9.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (74.67s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p calico-648814 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p calico-648814 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd: (1m14.665832501s)
--- PASS: TestNetworkPlugins/group/calico/Start (74.67s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-648814 exec deployment/netcat -- nslookup kubernetes.default
E0414 11:53:20.542085  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-648814 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-648814 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (58.05s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-flannel-648814 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd
E0414 11:53:48.244534  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/old-k8s-version-943255/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:54:26.417102  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/no-preload-391843/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-flannel-648814 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd: (58.048384623s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (58.05s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-pzcwj" [bdbc2821-a195-4c20-97bb-270fab8e792e] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 6.003994577s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p calico-648814 "pgrep -a kubelet"
I0414 11:54:41.295765  600227 config.go:182] Loaded profile config "calico-648814": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (11.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-648814 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-5d86dc444-x7pvm" [8119f547-c45a-4b2d-a6d8-6aa0069c92ee] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-5d86dc444-x7pvm" [8119f547-c45a-4b2d-a6d8-6aa0069c92ee] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 11.003092194s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (11.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p custom-flannel-648814 "pgrep -a kubelet"
I0414 11:54:43.847058  600227 config.go:182] Loaded profile config "custom-flannel-648814": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (10.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-648814 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-5d86dc444-k9plw" [a2a2062a-64b2-46f2-83d5-7f8bdd4964a8] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-5d86dc444-k9plw" [a2a2062a-64b2-46f2-83d5-7f8bdd4964a8] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 10.003613058s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (10.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-648814 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-648814 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-648814 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-648814 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-648814 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-648814 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (77.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p enable-default-cni-648814 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p enable-default-cni-648814 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd: (1m17.270822616s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (77.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (56.6s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p flannel-648814 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p flannel-648814 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd: (56.601082938s)
--- PASS: TestNetworkPlugins/group/flannel/Start (56.60s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-pfnf8" [d970992f-591a-4d9a-ab32-af139e0de7be] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 6.003940953s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p flannel-648814 "pgrep -a kubelet"
I0414 11:56:24.462273  600227 config.go:182] Loaded profile config "flannel-648814": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (9.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-648814 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-5d86dc444-p876h" [db1fed4f-9466-451e-85bb-34cbf6460cbe] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-5d86dc444-p876h" [db1fed4f-9466-451e-85bb-34cbf6460cbe] Running
E0414 11:56:30.950784  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/default-k8s-diff-port-689364/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:56:30.957341  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/default-k8s-diff-port-689364/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:56:30.968732  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/default-k8s-diff-port-689364/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:56:30.990186  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/default-k8s-diff-port-689364/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:56:31.031595  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/default-k8s-diff-port-689364/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:56:31.113687  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/default-k8s-diff-port-689364/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:56:31.275200  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/default-k8s-diff-port-689364/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:56:31.596859  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/default-k8s-diff-port-689364/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:56:32.239024  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/default-k8s-diff-port-689364/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:56:33.521130  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/default-k8s-diff-port-689364/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 9.00333239s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (9.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-648814 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-648814 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-648814 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p enable-default-cni-648814 "pgrep -a kubelet"
I0414 11:56:37.726320  600227 config.go:182] Loaded profile config "enable-default-cni-648814": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-648814 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-5d86dc444-h2mvw" [9a29480e-f4a8-48e9-90aa-abace90f0d16] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0414 11:56:41.209460  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/default-k8s-diff-port-689364/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:344: "netcat-5d86dc444-h2mvw" [9a29480e-f4a8-48e9-90aa-abace90f0d16] Running
E0414 11:56:45.981232  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/addons-459233/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 9.007458173s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-648814 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-648814 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-648814 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (49.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p bridge-648814 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p bridge-648814 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd: (49.277987873s)
--- PASS: TestNetworkPlugins/group/bridge/Start (49.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p bridge-648814 "pgrep -a kubelet"
I0414 11:57:46.497922  600227 config.go:182] Loaded profile config "bridge-648814": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.32.2
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (10.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-648814 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-5d86dc444-mvsks" [2f9524c5-9605-4716-8196-b5a7108fd9b8] Pending
E0414 11:57:48.562125  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/auto-648814/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:57:48.568595  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/auto-648814/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:57:48.580015  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/auto-648814/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:57:48.601580  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/auto-648814/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:57:48.642975  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/auto-648814/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:57:48.724430  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/auto-648814/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:344: "netcat-5d86dc444-mvsks" [2f9524c5-9605-4716-8196-b5a7108fd9b8] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0414 11:57:48.886442  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/auto-648814/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:57:49.208441  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/auto-648814/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:57:49.849759  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/auto-648814/client.crt: no such file or directory" logger="UnhandledError"
helpers_test.go:344: "netcat-5d86dc444-mvsks" [2f9524c5-9605-4716-8196-b5a7108fd9b8] Running
E0414 11:57:51.131509  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/auto-648814/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:57:52.895648  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/default-k8s-diff-port-689364/client.crt: no such file or directory" logger="UnhandledError"
E0414 11:57:53.693298  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/auto-648814/client.crt: no such file or directory" logger="UnhandledError"
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 10.003518749s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (10.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-648814 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-648814 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-648814 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
E0414 11:57:57.123848  600227 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/functional-068510/client.crt: no such file or directory" logger="UnhandledError"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.16s)

                                                
                                    

Test skip (30/331)

x
+
TestDownloadOnly/v1.20.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.20.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.20.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.20.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.32.2/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.32.2/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.32.2/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.32.2/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.32.2/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.32.2/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.32.2/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.32.2/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.32.2/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0.58s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:232: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p download-docker-121418 --alsologtostderr --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:244: Skip for arm64 platform. See https://github.com/kubernetes/minikube/issues/10144
helpers_test.go:175: Cleaning up "download-docker-121418" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p download-docker-121418
--- SKIP: TestDownloadOnlyKic (0.58s)

                                                
                                    
x
+
TestOffline (0s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:35: skipping TestOffline - only docker runtime supported on arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestOffline (0.00s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/RealCredentials (0.01s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/RealCredentials
addons_test.go:698: This test requires a GCE instance (excluding Cloud Shell) with a container based driver
--- SKIP: TestAddons/serial/GCPAuth/RealCredentials (0.01s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:422: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestAddons/parallel/AmdGpuDevicePlugin (0s)

                                                
                                                
=== RUN   TestAddons/parallel/AmdGpuDevicePlugin
=== PAUSE TestAddons/parallel/AmdGpuDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/AmdGpuDevicePlugin
addons_test.go:972: skip amd gpu test on all but docker driver and amd64 platform
--- SKIP: TestAddons/parallel/AmdGpuDevicePlugin (0.00s)

                                                
                                    
x
+
TestDockerFlags (0s)

                                                
                                                
=== RUN   TestDockerFlags
docker_test.go:41: skipping: only runs with docker container runtime, currently testing containerd
--- SKIP: TestDockerFlags (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:45: Skip if arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1804: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DockerEnv
functional_test.go:480: only validate docker env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:567: only validate podman env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestFunctionalNewestKubernetes (0s)

                                                
                                                
=== RUN   TestFunctionalNewestKubernetes
functional_test.go:84: 
--- SKIP: TestFunctionalNewestKubernetes (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild (0s)

                                                
                                                
=== RUN   TestImageBuild
image_test.go:33: 
--- SKIP: TestImageBuild (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestSkaffold (0s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing containerd container runtime
--- SKIP: TestSkaffold (0.00s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.21s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:101: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-655610" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p disable-driver-mounts-655610
--- SKIP: TestStartStop/group/disable-driver-mounts (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet (4.54s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet
net_test.go:93: Skipping the test as containerd container runtimes requires CNI
panic.go:631: 
----------------------- debugLogs start: kubenet-648814 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-648814

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: kubenet-648814

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-648814

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: kubenet-648814

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: kubenet-648814

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: kubenet-648814

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: kubenet-648814

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: kubenet-648814

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: kubenet-648814

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: kubenet-648814

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: kubenet-648814

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "kubenet-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "kubenet-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "kubenet-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "kubenet-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "kubenet-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "kubenet-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "kubenet-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "kubenet-648814" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "kubenet-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "kubenet-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "kubenet-648814" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/20534-594855/.minikube/ca.crt
extensions:
- extension:
last-update: Mon, 14 Apr 2025 11:33:53 UTC
provider: minikube.sigs.k8s.io
version: v1.35.0
name: cluster_info
server: https://192.168.85.2:8443
name: NoKubernetes-646025
contexts:
- context:
cluster: NoKubernetes-646025
extensions:
- extension:
last-update: Mon, 14 Apr 2025 11:33:53 UTC
provider: minikube.sigs.k8s.io
version: v1.35.0
name: context_info
namespace: default
user: NoKubernetes-646025
name: NoKubernetes-646025
current-context: ""
kind: Config
preferences: {}
users:
- name: NoKubernetes-646025
user:
client-certificate: /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/NoKubernetes-646025/client.crt
client-key: /home/jenkins/minikube-integration/20534-594855/.minikube/profiles/NoKubernetes-646025/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: kubenet-648814

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "kubenet-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-648814"

                                                
                                                
----------------------- debugLogs end: kubenet-648814 [took: 4.223517674s] --------------------------------
helpers_test.go:175: Cleaning up "kubenet-648814" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubenet-648814
--- SKIP: TestNetworkPlugins/group/kubenet (4.54s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (4.88s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:631: 
----------------------- debugLogs start: cilium-648814 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-648814" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-648814" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-648814" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-648814

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-648814" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-648814"

                                                
                                                
----------------------- debugLogs end: cilium-648814 [took: 4.730232856s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-648814" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cilium-648814
--- SKIP: TestNetworkPlugins/group/cilium (4.88s)

                                                
                                    
Copied to clipboard