Test Report: Docker_Linux_containerd_arm64 19282

                    
                      32a626fe994c067a2713ce1ccf4f75414e4ff172:2024-07-17:35384
                    
                

Test fail (1/336)

Order failed test Duration
311 TestStartStop/group/old-k8s-version/serial/SecondStart 381.31
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (381.31s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-069806 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p old-k8s-version-069806 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0: exit status 102 (6m17.756626636s)

                                                
                                                
-- stdout --
	* [old-k8s-version-069806] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19282
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.30.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.2
	* Using the docker driver based on existing profile
	* Starting "old-k8s-version-069806" primary control-plane node in "old-k8s-version-069806" cluster
	* Pulling base image v0.0.44-1721234491-19282 ...
	* Restarting existing docker container for "old-k8s-version-069806" ...
	* Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
	* Verifying Kubernetes components...
	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	  - Using image docker.io/kubernetesui/dashboard:v2.7.0
	  - Using image registry.k8s.io/echoserver:1.4
	  - Using image fake.domain/registry.k8s.io/echoserver:1.4
	* Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p old-k8s-version-069806 addons enable metrics-server
	
	* Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 20:24:22.361435  933934 out.go:291] Setting OutFile to fd 1 ...
	I0717 20:24:22.361600  933934 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 20:24:22.361611  933934 out.go:304] Setting ErrFile to fd 2...
	I0717 20:24:22.361616  933934 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 20:24:22.361859  933934 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
	I0717 20:24:22.362242  933934 out.go:298] Setting JSON to false
	I0717 20:24:22.363330  933934 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":14810,"bootTime":1721233052,"procs":199,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0717 20:24:22.363408  933934 start.go:139] virtualization:  
	I0717 20:24:22.365785  933934 out.go:177] * [old-k8s-version-069806] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0717 20:24:22.367675  933934 out.go:177]   - MINIKUBE_LOCATION=19282
	I0717 20:24:22.367725  933934 notify.go:220] Checking for updates...
	I0717 20:24:22.372387  933934 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 20:24:22.374035  933934 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig
	I0717 20:24:22.375652  933934 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube
	I0717 20:24:22.377107  933934 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0717 20:24:22.378675  933934 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0717 20:24:22.381168  933934 config.go:182] Loaded profile config "old-k8s-version-069806": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0717 20:24:22.383299  933934 out.go:177] * Kubernetes 1.30.2 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.30.2
	I0717 20:24:22.384722  933934 driver.go:392] Setting default libvirt URI to qemu:///system
	I0717 20:24:22.411139  933934 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0717 20:24:22.411269  933934 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:24:22.497654  933934 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:58 OomKillDisable:true NGoroutines:68 SystemTime:2024-07-17 20:24:22.488092151 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0717 20:24:22.497770  933934 docker.go:307] overlay module found
	I0717 20:24:22.499856  933934 out.go:177] * Using the docker driver based on existing profile
	I0717 20:24:22.501605  933934 start.go:297] selected driver: docker
	I0717 20:24:22.501629  933934 start.go:901] validating driver "docker" against &{Name:old-k8s-version-069806 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-069806 Namespace:default APIServerHAVIP: AP
IServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:fa
lse MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0717 20:24:22.501757  933934 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0717 20:24:22.502384  933934 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:24:22.616503  933934 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:58 OomKillDisable:true NGoroutines:68 SystemTime:2024-07-17 20:24:22.587988704 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0717 20:24:22.616862  933934 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0717 20:24:22.616929  933934 cni.go:84] Creating CNI manager for ""
	I0717 20:24:22.616945  933934 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 20:24:22.616997  933934 start.go:340] cluster config:
	{Name:old-k8s-version-069806 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-069806 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0717 20:24:22.618991  933934 out.go:177] * Starting "old-k8s-version-069806" primary control-plane node in "old-k8s-version-069806" cluster
	I0717 20:24:22.620774  933934 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0717 20:24:22.622719  933934 out.go:177] * Pulling base image v0.0.44-1721234491-19282 ...
	I0717 20:24:22.624361  933934 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0717 20:24:22.624428  933934 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19282-720845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
	I0717 20:24:22.624463  933934 cache.go:56] Caching tarball of preloaded images
	I0717 20:24:22.624559  933934 preload.go:172] Found /home/jenkins/minikube-integration/19282-720845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I0717 20:24:22.624574  933934 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on containerd
	I0717 20:24:22.624691  933934 profile.go:143] Saving config to /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/config.json ...
	I0717 20:24:22.624915  933934 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 in local docker daemon
	W0717 20:24:22.657056  933934 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 is of wrong architecture
	I0717 20:24:22.657079  933934 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 to local cache
	I0717 20:24:22.657161  933934 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 in local cache directory
	I0717 20:24:22.657178  933934 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 in local cache directory, skipping pull
	I0717 20:24:22.657182  933934 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 exists in cache, skipping pull
	I0717 20:24:22.657191  933934 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 as a tarball
	I0717 20:24:22.657196  933934 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 from local cache
	I0717 20:24:22.782332  933934 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 from cached tarball
	I0717 20:24:22.782373  933934 cache.go:194] Successfully downloaded all kic artifacts
	I0717 20:24:22.782413  933934 start.go:360] acquireMachinesLock for old-k8s-version-069806: {Name:mkda59be69caa725b78e8ee12ffcee3804c6aa24 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0717 20:24:22.782483  933934 start.go:364] duration metric: took 45.218µs to acquireMachinesLock for "old-k8s-version-069806"
	I0717 20:24:22.782503  933934 start.go:96] Skipping create...Using existing machine configuration
	I0717 20:24:22.782508  933934 fix.go:54] fixHost starting: 
	I0717 20:24:22.782806  933934 cli_runner.go:164] Run: docker container inspect old-k8s-version-069806 --format={{.State.Status}}
	I0717 20:24:22.799554  933934 fix.go:112] recreateIfNeeded on old-k8s-version-069806: state=Stopped err=<nil>
	W0717 20:24:22.799594  933934 fix.go:138] unexpected machine state, will restart: <nil>
	I0717 20:24:22.803493  933934 out.go:177] * Restarting existing docker container for "old-k8s-version-069806" ...
	I0717 20:24:22.805480  933934 cli_runner.go:164] Run: docker start old-k8s-version-069806
	I0717 20:24:23.161539  933934 cli_runner.go:164] Run: docker container inspect old-k8s-version-069806 --format={{.State.Status}}
	I0717 20:24:23.181855  933934 kic.go:430] container "old-k8s-version-069806" state is running.
	I0717 20:24:23.182255  933934 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-069806
	I0717 20:24:23.203209  933934 profile.go:143] Saving config to /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/config.json ...
	I0717 20:24:23.203529  933934 machine.go:94] provisionDockerMachine start ...
	I0717 20:24:23.203607  933934 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-069806
	I0717 20:24:23.234055  933934 main.go:141] libmachine: Using SSH client type: native
	I0717 20:24:23.234349  933934 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2c70] 0x3e54d0 <nil>  [] 0s} 127.0.0.1 33824 <nil> <nil>}
	I0717 20:24:23.234358  933934 main.go:141] libmachine: About to run SSH command:
	hostname
	I0717 20:24:23.235020  933934 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0717 20:24:26.371546  933934 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-069806
	
	I0717 20:24:26.371574  933934 ubuntu.go:169] provisioning hostname "old-k8s-version-069806"
	I0717 20:24:26.371647  933934 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-069806
	I0717 20:24:26.391627  933934 main.go:141] libmachine: Using SSH client type: native
	I0717 20:24:26.391869  933934 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2c70] 0x3e54d0 <nil>  [] 0s} 127.0.0.1 33824 <nil> <nil>}
	I0717 20:24:26.391881  933934 main.go:141] libmachine: About to run SSH command:
	sudo hostname old-k8s-version-069806 && echo "old-k8s-version-069806" | sudo tee /etc/hostname
	I0717 20:24:26.543007  933934 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-069806
	
	I0717 20:24:26.543157  933934 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-069806
	I0717 20:24:26.569673  933934 main.go:141] libmachine: Using SSH client type: native
	I0717 20:24:26.569924  933934 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2c70] 0x3e54d0 <nil>  [] 0s} 127.0.0.1 33824 <nil> <nil>}
	I0717 20:24:26.569941  933934 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sold-k8s-version-069806' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-069806/g' /etc/hosts;
				else 
					echo '127.0.1.1 old-k8s-version-069806' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0717 20:24:26.708266  933934 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0717 20:24:26.708343  933934 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19282-720845/.minikube CaCertPath:/home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19282-720845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19282-720845/.minikube}
	I0717 20:24:26.708388  933934 ubuntu.go:177] setting up certificates
	I0717 20:24:26.708425  933934 provision.go:84] configureAuth start
	I0717 20:24:26.708522  933934 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-069806
	I0717 20:24:26.732363  933934 provision.go:143] copyHostCerts
	I0717 20:24:26.732427  933934 exec_runner.go:144] found /home/jenkins/minikube-integration/19282-720845/.minikube/ca.pem, removing ...
	I0717 20:24:26.732436  933934 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19282-720845/.minikube/ca.pem
	I0717 20:24:26.732508  933934 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19282-720845/.minikube/ca.pem (1078 bytes)
	I0717 20:24:26.732605  933934 exec_runner.go:144] found /home/jenkins/minikube-integration/19282-720845/.minikube/cert.pem, removing ...
	I0717 20:24:26.732611  933934 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19282-720845/.minikube/cert.pem
	I0717 20:24:26.732643  933934 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19282-720845/.minikube/cert.pem (1123 bytes)
	I0717 20:24:26.732693  933934 exec_runner.go:144] found /home/jenkins/minikube-integration/19282-720845/.minikube/key.pem, removing ...
	I0717 20:24:26.732698  933934 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19282-720845/.minikube/key.pem
	I0717 20:24:26.732724  933934 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19282-720845/.minikube/key.pem (1679 bytes)
	I0717 20:24:26.732768  933934 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19282-720845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-069806 san=[127.0.0.1 192.168.76.2 localhost minikube old-k8s-version-069806]
	I0717 20:24:27.112510  933934 provision.go:177] copyRemoteCerts
	I0717 20:24:27.112625  933934 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0717 20:24:27.112701  933934 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-069806
	I0717 20:24:27.132540  933934 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33824 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/old-k8s-version-069806/id_rsa Username:docker}
	I0717 20:24:27.227046  933934 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
	I0717 20:24:27.252833  933934 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0717 20:24:27.278711  933934 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0717 20:24:27.310082  933934 provision.go:87] duration metric: took 601.622597ms to configureAuth
	I0717 20:24:27.310111  933934 ubuntu.go:193] setting minikube options for container-runtime
	I0717 20:24:27.310307  933934 config.go:182] Loaded profile config "old-k8s-version-069806": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0717 20:24:27.310319  933934 machine.go:97] duration metric: took 4.106770581s to provisionDockerMachine
	I0717 20:24:27.310336  933934 start.go:293] postStartSetup for "old-k8s-version-069806" (driver="docker")
	I0717 20:24:27.310350  933934 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0717 20:24:27.310410  933934 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0717 20:24:27.310454  933934 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-069806
	I0717 20:24:27.329494  933934 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33824 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/old-k8s-version-069806/id_rsa Username:docker}
	I0717 20:24:27.432906  933934 ssh_runner.go:195] Run: cat /etc/os-release
	I0717 20:24:27.440673  933934 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0717 20:24:27.440762  933934 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0717 20:24:27.440788  933934 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0717 20:24:27.440834  933934 info.go:137] Remote host: Ubuntu 22.04.4 LTS
	I0717 20:24:27.440864  933934 filesync.go:126] Scanning /home/jenkins/minikube-integration/19282-720845/.minikube/addons for local assets ...
	I0717 20:24:27.440964  933934 filesync.go:126] Scanning /home/jenkins/minikube-integration/19282-720845/.minikube/files for local assets ...
	I0717 20:24:27.441098  933934 filesync.go:149] local asset: /home/jenkins/minikube-integration/19282-720845/.minikube/files/etc/ssl/certs/7262252.pem -> 7262252.pem in /etc/ssl/certs
	I0717 20:24:27.441254  933934 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0717 20:24:27.451715  933934 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/files/etc/ssl/certs/7262252.pem --> /etc/ssl/certs/7262252.pem (1708 bytes)
	I0717 20:24:27.486719  933934 start.go:296] duration metric: took 176.364021ms for postStartSetup
	I0717 20:24:27.486847  933934 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0717 20:24:27.486944  933934 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-069806
	I0717 20:24:27.506408  933934 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33824 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/old-k8s-version-069806/id_rsa Username:docker}
	I0717 20:24:27.601844  933934 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0717 20:24:27.606920  933934 fix.go:56] duration metric: took 4.824402733s for fixHost
	I0717 20:24:27.606945  933934 start.go:83] releasing machines lock for "old-k8s-version-069806", held for 4.82445471s
	I0717 20:24:27.607017  933934 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-069806
	I0717 20:24:27.626375  933934 ssh_runner.go:195] Run: cat /version.json
	I0717 20:24:27.626438  933934 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-069806
	I0717 20:24:27.626669  933934 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0717 20:24:27.626734  933934 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-069806
	I0717 20:24:27.654129  933934 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33824 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/old-k8s-version-069806/id_rsa Username:docker}
	I0717 20:24:27.665946  933934 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33824 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/old-k8s-version-069806/id_rsa Username:docker}
	I0717 20:24:27.896216  933934 ssh_runner.go:195] Run: systemctl --version
	I0717 20:24:27.900756  933934 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0717 20:24:27.905260  933934 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0717 20:24:27.932174  933934 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0717 20:24:27.932258  933934 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0717 20:24:27.941298  933934 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0717 20:24:27.941327  933934 start.go:495] detecting cgroup driver to use...
	I0717 20:24:27.941361  933934 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0717 20:24:27.941415  933934 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0717 20:24:27.956583  933934 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0717 20:24:27.968994  933934 docker.go:217] disabling cri-docker service (if available) ...
	I0717 20:24:27.969066  933934 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0717 20:24:27.982838  933934 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0717 20:24:28.000460  933934 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0717 20:24:28.106593  933934 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0717 20:24:28.207017  933934 docker.go:233] disabling docker service ...
	I0717 20:24:28.207085  933934 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0717 20:24:28.221965  933934 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0717 20:24:28.234818  933934 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0717 20:24:28.323811  933934 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0717 20:24:28.419756  933934 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0717 20:24:28.433226  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0717 20:24:28.460878  933934 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
	I0717 20:24:28.473310  933934 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0717 20:24:28.484005  933934 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I0717 20:24:28.484103  933934 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0717 20:24:28.502728  933934 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0717 20:24:28.517779  933934 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0717 20:24:28.529870  933934 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0717 20:24:28.540776  933934 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0717 20:24:28.551249  933934 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0717 20:24:28.562393  933934 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0717 20:24:28.571958  933934 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0717 20:24:28.581134  933934 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0717 20:24:28.690986  933934 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0717 20:24:28.884812  933934 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
	I0717 20:24:28.884896  933934 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0717 20:24:28.888960  933934 start.go:563] Will wait 60s for crictl version
	I0717 20:24:28.889027  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:24:28.893691  933934 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0717 20:24:28.939074  933934 start.go:579] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.7.19
	RuntimeApiVersion:  v1
	I0717 20:24:28.939155  933934 ssh_runner.go:195] Run: containerd --version
	I0717 20:24:28.966444  933934 ssh_runner.go:195] Run: containerd --version
	I0717 20:24:28.991702  933934 out.go:177] * Preparing Kubernetes v1.20.0 on containerd 1.7.19 ...
	I0717 20:24:28.993495  933934 cli_runner.go:164] Run: docker network inspect old-k8s-version-069806 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0717 20:24:29.011591  933934 ssh_runner.go:195] Run: grep 192.168.76.1	host.minikube.internal$ /etc/hosts
	I0717 20:24:29.015776  933934 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0717 20:24:29.027761  933934 kubeadm.go:883] updating cluster {Name:old-k8s-version-069806 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-069806 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0717 20:24:29.027894  933934 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0717 20:24:29.027969  933934 ssh_runner.go:195] Run: sudo crictl images --output json
	I0717 20:24:29.070038  933934 containerd.go:627] all images are preloaded for containerd runtime.
	I0717 20:24:29.070064  933934 containerd.go:534] Images already preloaded, skipping extraction
	I0717 20:24:29.070124  933934 ssh_runner.go:195] Run: sudo crictl images --output json
	I0717 20:24:29.107810  933934 containerd.go:627] all images are preloaded for containerd runtime.
	I0717 20:24:29.107836  933934 cache_images.go:84] Images are preloaded, skipping loading
	I0717 20:24:29.107845  933934 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.20.0 containerd true true} ...
	I0717 20:24:29.107965  933934 kubeadm.go:946] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=old-k8s-version-069806 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.76.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-069806 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0717 20:24:29.108038  933934 ssh_runner.go:195] Run: sudo crictl info
	I0717 20:24:29.155340  933934 cni.go:84] Creating CNI manager for ""
	I0717 20:24:29.155364  933934 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 20:24:29.155374  933934 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0717 20:24:29.155394  933934 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-069806 NodeName:old-k8s-version-069806 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt
StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
	I0717 20:24:29.155540  933934 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.76.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "old-k8s-version-069806"
	  kubeletExtraArgs:
	    node-ip: 192.168.76.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.20.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0717 20:24:29.155626  933934 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
	I0717 20:24:29.165912  933934 binaries.go:44] Found k8s binaries, skipping transfer
	I0717 20:24:29.166018  933934 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0717 20:24:29.176908  933934 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (442 bytes)
	I0717 20:24:29.197452  933934 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0717 20:24:29.217867  933934 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2125 bytes)
	I0717 20:24:29.236927  933934 ssh_runner.go:195] Run: grep 192.168.76.2	control-plane.minikube.internal$ /etc/hosts
	I0717 20:24:29.241021  933934 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0717 20:24:29.252344  933934 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0717 20:24:29.344067  933934 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0717 20:24:29.358767  933934 certs.go:68] Setting up /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806 for IP: 192.168.76.2
	I0717 20:24:29.358789  933934 certs.go:194] generating shared ca certs ...
	I0717 20:24:29.358805  933934 certs.go:226] acquiring lock for ca certs: {Name:mk70fd46ee08fce14a9e7548fea7cc8fad7ae6a2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:24:29.358939  933934 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19282-720845/.minikube/ca.key
	I0717 20:24:29.358981  933934 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19282-720845/.minikube/proxy-client-ca.key
	I0717 20:24:29.358988  933934 certs.go:256] generating profile certs ...
	I0717 20:24:29.359076  933934 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.key
	I0717 20:24:29.359137  933934 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/apiserver.key.a9b625be
	I0717 20:24:29.359185  933934 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/proxy-client.key
	I0717 20:24:29.359294  933934 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/726225.pem (1338 bytes)
	W0717 20:24:29.359324  933934 certs.go:480] ignoring /home/jenkins/minikube-integration/19282-720845/.minikube/certs/726225_empty.pem, impossibly tiny 0 bytes
	I0717 20:24:29.359332  933934 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca-key.pem (1675 bytes)
	I0717 20:24:29.359358  933934 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca.pem (1078 bytes)
	I0717 20:24:29.359381  933934 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/cert.pem (1123 bytes)
	I0717 20:24:29.359404  933934 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/key.pem (1679 bytes)
	I0717 20:24:29.359445  933934 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-720845/.minikube/files/etc/ssl/certs/7262252.pem (1708 bytes)
	I0717 20:24:29.360168  933934 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0717 20:24:29.394896  933934 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0717 20:24:29.429187  933934 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0717 20:24:29.457525  933934 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0717 20:24:29.486295  933934 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I0717 20:24:29.512168  933934 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0717 20:24:29.541302  933934 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0717 20:24:29.570429  933934 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0717 20:24:29.598000  933934 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/files/etc/ssl/certs/7262252.pem --> /usr/share/ca-certificates/7262252.pem (1708 bytes)
	I0717 20:24:29.622949  933934 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0717 20:24:29.649050  933934 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/certs/726225.pem --> /usr/share/ca-certificates/726225.pem (1338 bytes)
	I0717 20:24:29.675970  933934 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0717 20:24:29.695279  933934 ssh_runner.go:195] Run: openssl version
	I0717 20:24:29.702102  933934 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7262252.pem && ln -fs /usr/share/ca-certificates/7262252.pem /etc/ssl/certs/7262252.pem"
	I0717 20:24:29.711668  933934 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7262252.pem
	I0717 20:24:29.715536  933934 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 17 19:43 /usr/share/ca-certificates/7262252.pem
	I0717 20:24:29.715614  933934 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7262252.pem
	I0717 20:24:29.722676  933934 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/7262252.pem /etc/ssl/certs/3ec20f2e.0"
	I0717 20:24:29.731892  933934 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0717 20:24:29.741654  933934 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0717 20:24:29.745305  933934 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 17 19:36 /usr/share/ca-certificates/minikubeCA.pem
	I0717 20:24:29.745419  933934 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0717 20:24:29.752421  933934 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0717 20:24:29.761728  933934 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/726225.pem && ln -fs /usr/share/ca-certificates/726225.pem /etc/ssl/certs/726225.pem"
	I0717 20:24:29.772472  933934 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/726225.pem
	I0717 20:24:29.776319  933934 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 17 19:43 /usr/share/ca-certificates/726225.pem
	I0717 20:24:29.776415  933934 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/726225.pem
	I0717 20:24:29.783551  933934 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/726225.pem /etc/ssl/certs/51391683.0"
	I0717 20:24:29.792880  933934 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0717 20:24:29.796571  933934 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0717 20:24:29.803343  933934 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0717 20:24:29.810364  933934 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0717 20:24:29.817376  933934 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0717 20:24:29.824211  933934 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0717 20:24:29.831349  933934 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0717 20:24:29.838320  933934 kubeadm.go:392] StartCluster: {Name:old-k8s-version-069806 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-069806 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/hom
e/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0717 20:24:29.838437  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0717 20:24:29.838505  933934 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0717 20:24:29.883620  933934 cri.go:89] found id: "cedac39d388652063b8130953072e79d032964b2a68154d6caf6d05d410673da"
	I0717 20:24:29.883645  933934 cri.go:89] found id: "03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294"
	I0717 20:24:29.883651  933934 cri.go:89] found id: "62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b"
	I0717 20:24:29.883655  933934 cri.go:89] found id: "0a4ebe1729293ed43248c2cc5f011a443aa3d9aeac69ec4546c5c944f657b6dd"
	I0717 20:24:29.883666  933934 cri.go:89] found id: "3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4"
	I0717 20:24:29.883671  933934 cri.go:89] found id: "bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef"
	I0717 20:24:29.883674  933934 cri.go:89] found id: "fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f"
	I0717 20:24:29.883677  933934 cri.go:89] found id: "e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1"
	I0717 20:24:29.883680  933934 cri.go:89] found id: "f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc"
	I0717 20:24:29.883687  933934 cri.go:89] found id: ""
	I0717 20:24:29.883739  933934 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0717 20:24:29.909404  933934 cri.go:116] JSON = null
	W0717 20:24:29.909470  933934 kubeadm.go:399] unpause failed: list paused: list returned 0 containers, but ps returned 9
	I0717 20:24:29.909556  933934 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0717 20:24:29.920679  933934 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0717 20:24:29.920703  933934 kubeadm.go:593] restartPrimaryControlPlane start ...
	I0717 20:24:29.920796  933934 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0717 20:24:29.932617  933934 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0717 20:24:29.933262  933934 kubeconfig.go:47] verify endpoint returned: get endpoint: "old-k8s-version-069806" does not appear in /home/jenkins/minikube-integration/19282-720845/kubeconfig
	I0717 20:24:29.933545  933934 kubeconfig.go:62] /home/jenkins/minikube-integration/19282-720845/kubeconfig needs updating (will repair): [kubeconfig missing "old-k8s-version-069806" cluster setting kubeconfig missing "old-k8s-version-069806" context setting]
	I0717 20:24:29.934053  933934 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-720845/kubeconfig: {Name:mkbb7ab9923e54de6b296ef688e430b421215a90 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:24:29.935839  933934 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0717 20:24:29.947611  933934 kubeadm.go:630] The running cluster does not require reconfiguration: 192.168.76.2
	I0717 20:24:29.947647  933934 kubeadm.go:597] duration metric: took 26.938238ms to restartPrimaryControlPlane
	I0717 20:24:29.947657  933934 kubeadm.go:394] duration metric: took 109.346701ms to StartCluster
	I0717 20:24:29.947681  933934 settings.go:142] acquiring lock: {Name:mk16909496744bd83f0170452b855928c1fb4054 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:24:29.947753  933934 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19282-720845/kubeconfig
	I0717 20:24:29.948850  933934 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-720845/kubeconfig: {Name:mkbb7ab9923e54de6b296ef688e430b421215a90 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:24:29.949084  933934 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0717 20:24:29.949499  933934 config.go:182] Loaded profile config "old-k8s-version-069806": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0717 20:24:29.949478  933934 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0717 20:24:29.949563  933934 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-069806"
	I0717 20:24:29.949571  933934 addons.go:69] Setting dashboard=true in profile "old-k8s-version-069806"
	I0717 20:24:29.949590  933934 addons.go:234] Setting addon storage-provisioner=true in "old-k8s-version-069806"
	I0717 20:24:29.949593  933934 addons.go:234] Setting addon dashboard=true in "old-k8s-version-069806"
	W0717 20:24:29.949597  933934 addons.go:243] addon storage-provisioner should already be in state true
	W0717 20:24:29.949600  933934 addons.go:243] addon dashboard should already be in state true
	I0717 20:24:29.949622  933934 host.go:66] Checking if "old-k8s-version-069806" exists ...
	I0717 20:24:29.949714  933934 host.go:66] Checking if "old-k8s-version-069806" exists ...
	I0717 20:24:29.950048  933934 cli_runner.go:164] Run: docker container inspect old-k8s-version-069806 --format={{.State.Status}}
	I0717 20:24:29.950215  933934 cli_runner.go:164] Run: docker container inspect old-k8s-version-069806 --format={{.State.Status}}
	I0717 20:24:29.950677  933934 addons.go:69] Setting metrics-server=true in profile "old-k8s-version-069806"
	I0717 20:24:29.950714  933934 addons.go:234] Setting addon metrics-server=true in "old-k8s-version-069806"
	W0717 20:24:29.950721  933934 addons.go:243] addon metrics-server should already be in state true
	I0717 20:24:29.950747  933934 host.go:66] Checking if "old-k8s-version-069806" exists ...
	I0717 20:24:29.951157  933934 cli_runner.go:164] Run: docker container inspect old-k8s-version-069806 --format={{.State.Status}}
	I0717 20:24:29.949565  933934 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-069806"
	I0717 20:24:29.953466  933934 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-069806"
	I0717 20:24:29.953764  933934 cli_runner.go:164] Run: docker container inspect old-k8s-version-069806 --format={{.State.Status}}
	I0717 20:24:29.954957  933934 out.go:177] * Verifying Kubernetes components...
	I0717 20:24:29.960508  933934 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0717 20:24:30.010428  933934 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0717 20:24:30.011416  933934 out.go:177]   - Using image docker.io/kubernetesui/dashboard:v2.7.0
	I0717 20:24:30.012415  933934 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0717 20:24:30.012443  933934 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0717 20:24:30.012520  933934 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-069806
	I0717 20:24:30.016331  933934 addons.go:234] Setting addon default-storageclass=true in "old-k8s-version-069806"
	W0717 20:24:30.016362  933934 addons.go:243] addon default-storageclass should already be in state true
	I0717 20:24:30.016393  933934 host.go:66] Checking if "old-k8s-version-069806" exists ...
	I0717 20:24:30.018108  933934 out.go:177]   - Using image registry.k8s.io/echoserver:1.4
	I0717 20:24:30.018657  933934 cli_runner.go:164] Run: docker container inspect old-k8s-version-069806 --format={{.State.Status}}
	I0717 20:24:30.026719  933934 addons.go:431] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0717 20:24:30.026746  933934 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0717 20:24:30.026824  933934 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-069806
	I0717 20:24:30.058823  933934 out.go:177]   - Using image fake.domain/registry.k8s.io/echoserver:1.4
	I0717 20:24:30.061187  933934 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0717 20:24:30.061224  933934 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0717 20:24:30.061340  933934 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-069806
	I0717 20:24:30.083754  933934 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33824 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/old-k8s-version-069806/id_rsa Username:docker}
	I0717 20:24:30.103106  933934 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
	I0717 20:24:30.103139  933934 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0717 20:24:30.103212  933934 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-069806
	I0717 20:24:30.146962  933934 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33824 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/old-k8s-version-069806/id_rsa Username:docker}
	I0717 20:24:30.155738  933934 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33824 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/old-k8s-version-069806/id_rsa Username:docker}
	I0717 20:24:30.194006  933934 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33824 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/old-k8s-version-069806/id_rsa Username:docker}
	I0717 20:24:30.203438  933934 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0717 20:24:30.239663  933934 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-069806" to be "Ready" ...
	I0717 20:24:30.279914  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0717 20:24:30.308012  933934 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0717 20:24:30.308103  933934 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0717 20:24:30.343886  933934 addons.go:431] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0717 20:24:30.343955  933934 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0717 20:24:30.350683  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0717 20:24:30.353435  933934 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0717 20:24:30.353463  933934 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
	I0717 20:24:30.391240  933934 addons.go:431] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0717 20:24:30.391266  933934 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	I0717 20:24:30.411729  933934 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0717 20:24:30.411755  933934 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0717 20:24:30.446187  933934 addons.go:431] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0717 20:24:30.446218  933934 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
	W0717 20:24:30.448955  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:30.448988  933934 retry.go:31] will retry after 220.918466ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:30.474593  933934 addons.go:431] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0717 20:24:30.474623  933934 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0717 20:24:30.483001  933934 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0717 20:24:30.483028  933934 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0717 20:24:30.511061  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0717 20:24:30.532408  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:30.532450  933934 retry.go:31] will retry after 237.70842ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:30.537552  933934 addons.go:431] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0717 20:24:30.537584  933934 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0717 20:24:30.558253  933934 addons.go:431] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0717 20:24:30.558279  933934 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0717 20:24:30.578688  933934 addons.go:431] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0717 20:24:30.578717  933934 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0717 20:24:30.602947  933934 addons.go:431] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0717 20:24:30.602975  933934 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	W0717 20:24:30.620800  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:30.620836  933934 retry.go:31] will retry after 294.344052ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:30.624569  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0717 20:24:30.670831  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0717 20:24:30.717086  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:30.717194  933934 retry.go:31] will retry after 252.495536ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0717 20:24:30.767543  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:30.767634  933934 retry.go:31] will retry after 356.263852ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:30.770872  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0717 20:24:30.845596  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:30.845629  933934 retry.go:31] will retry after 335.890512ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:30.915784  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0717 20:24:30.969887  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0717 20:24:31.003615  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:31.003659  933934 retry.go:31] will retry after 319.794296ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0717 20:24:31.066108  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:31.066148  933934 retry.go:31] will retry after 376.760595ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:31.124303  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0717 20:24:31.181703  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0717 20:24:31.202722  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:31.202920  933934 retry.go:31] will retry after 693.030919ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0717 20:24:31.264832  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:31.264864  933934 retry.go:31] will retry after 652.00017ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:31.324023  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0717 20:24:31.395000  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:31.395035  933934 retry.go:31] will retry after 319.844346ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:31.443151  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0717 20:24:31.522859  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:31.522895  933934 retry.go:31] will retry after 550.426328ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:31.715121  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0717 20:24:31.793108  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:31.793143  933934 retry.go:31] will retry after 470.462011ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:31.896218  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0717 20:24:31.917588  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0717 20:24:32.011273  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:32.011308  933934 retry.go:31] will retry after 717.978064ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0717 20:24:32.025586  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:32.025633  933934 retry.go:31] will retry after 688.036208ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:32.073833  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0717 20:24:32.156402  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:32.156439  933934 retry.go:31] will retry after 804.849597ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:32.240928  933934 node_ready.go:53] error getting node "old-k8s-version-069806": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-069806": dial tcp 192.168.76.2:8443: connect: connection refused
	I0717 20:24:32.264230  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0717 20:24:32.348914  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:32.348948  933934 retry.go:31] will retry after 753.560302ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:32.714289  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0717 20:24:32.729614  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0717 20:24:32.814985  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:32.815019  933934 retry.go:31] will retry after 1.70995206s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0717 20:24:32.835387  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:32.835419  933934 retry.go:31] will retry after 1.033052501s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:32.961566  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0717 20:24:33.035846  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:33.035883  933934 retry.go:31] will retry after 683.194987ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:33.103044  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0717 20:24:33.176414  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:33.176446  933934 retry.go:31] will retry after 984.17656ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:33.719575  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0717 20:24:33.795856  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:33.795903  933934 retry.go:31] will retry after 2.044995846s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:33.869209  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0717 20:24:33.949879  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:33.949962  933934 retry.go:31] will retry after 1.905710864s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:34.161482  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0717 20:24:34.231265  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:34.231299  933934 retry.go:31] will retry after 4.242109517s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:34.525198  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0717 20:24:34.614329  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:34.614379  933934 retry.go:31] will retry after 2.2166745s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:34.740941  933934 node_ready.go:53] error getting node "old-k8s-version-069806": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-069806": dial tcp 192.168.76.2:8443: connect: connection refused
	I0717 20:24:35.841183  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0717 20:24:35.856763  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	W0717 20:24:35.947506  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:35.947563  933934 retry.go:31] will retry after 1.593813903s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	W0717 20:24:35.956182  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:35.956217  933934 retry.go:31] will retry after 3.644568339s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:36.741161  933934 node_ready.go:53] error getting node "old-k8s-version-069806": Get "https://192.168.76.2:8443/api/v1/nodes/old-k8s-version-069806": dial tcp 192.168.76.2:8443: connect: connection refused
	I0717 20:24:36.831300  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	W0717 20:24:36.903765  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:36.903801  933934 retry.go:31] will retry after 3.217969809s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:37.542429  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	W0717 20:24:37.613029  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:37.613064  933934 retry.go:31] will retry after 6.11181412s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:38.474153  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	W0717 20:24:38.663570  933934 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:38.663620  933934 retry.go:31] will retry after 5.57518338s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	I0717 20:24:39.600977  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0717 20:24:40.122878  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0717 20:24:43.725089  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0717 20:24:44.239027  933934 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0717 20:24:47.113690  933934 node_ready.go:49] node "old-k8s-version-069806" has status "Ready":"True"
	I0717 20:24:47.113716  933934 node_ready.go:38] duration metric: took 16.873996969s for node "old-k8s-version-069806" to be "Ready" ...
	I0717 20:24:47.113727  933934 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0717 20:24:47.458277  933934 pod_ready.go:78] waiting up to 6m0s for pod "coredns-74ff55c5b-9djzb" in "kube-system" namespace to be "Ready" ...
	I0717 20:24:47.588913  933934 pod_ready.go:92] pod "coredns-74ff55c5b-9djzb" in "kube-system" namespace has status "Ready":"True"
	I0717 20:24:47.588994  933934 pod_ready.go:81] duration metric: took 130.626529ms for pod "coredns-74ff55c5b-9djzb" in "kube-system" namespace to be "Ready" ...
	I0717 20:24:47.589022  933934 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-069806" in "kube-system" namespace to be "Ready" ...
	I0717 20:24:47.637205  933934 pod_ready.go:92] pod "etcd-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"True"
	I0717 20:24:47.637287  933934 pod_ready.go:81] duration metric: took 48.226749ms for pod "etcd-old-k8s-version-069806" in "kube-system" namespace to be "Ready" ...
	I0717 20:24:47.637317  933934 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-069806" in "kube-system" namespace to be "Ready" ...
	I0717 20:24:47.685841  933934 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"True"
	I0717 20:24:47.685918  933934 pod_ready.go:81] duration metric: took 48.579175ms for pod "kube-apiserver-old-k8s-version-069806" in "kube-system" namespace to be "Ready" ...
	I0717 20:24:47.685945  933934 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace to be "Ready" ...
	I0717 20:24:48.563209  933934 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (8.440288721s)
	I0717 20:24:48.565544  933934 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (8.964523773s)
	I0717 20:24:49.087493  933934 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (4.848404431s)
	I0717 20:24:49.087579  933934 addons.go:475] Verifying addon metrics-server=true in "old-k8s-version-069806"
	I0717 20:24:49.087767  933934 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply --force -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (5.362632755s)
	I0717 20:24:49.090298  933934 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p old-k8s-version-069806 addons enable metrics-server
	
	I0717 20:24:49.092002  933934 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
	I0717 20:24:49.093926  933934 addons.go:510] duration metric: took 19.144446544s for enable addons: enabled=[storage-provisioner default-storageclass metrics-server dashboard]
	I0717 20:24:49.691938  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:24:52.193749  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:24:54.692754  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:24:56.693229  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:24:59.193036  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:01.193937  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:03.195566  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:05.693761  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:08.193030  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:10.193723  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:12.693228  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:14.694495  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:17.192795  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:19.193419  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:21.694868  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:24.193154  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:26.692069  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:28.693733  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:31.193491  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:33.692656  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:36.193611  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:38.202362  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:40.694160  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:43.193212  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:45.195429  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:47.692458  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:49.692503  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:52.193357  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:54.692959  933934 pod_ready.go:102] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:55.200201  933934 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"True"
	I0717 20:25:55.200229  933934 pod_ready.go:81] duration metric: took 1m7.514262075s for pod "kube-controller-manager-old-k8s-version-069806" in "kube-system" namespace to be "Ready" ...
	I0717 20:25:55.200243  933934 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-gh8ms" in "kube-system" namespace to be "Ready" ...
	I0717 20:25:55.207436  933934 pod_ready.go:92] pod "kube-proxy-gh8ms" in "kube-system" namespace has status "Ready":"True"
	I0717 20:25:55.207465  933934 pod_ready.go:81] duration metric: took 7.18782ms for pod "kube-proxy-gh8ms" in "kube-system" namespace to be "Ready" ...
	I0717 20:25:55.207478  933934 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-069806" in "kube-system" namespace to be "Ready" ...
	I0717 20:25:57.213200  933934 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:25:59.213492  933934 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:01.214393  933934 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:03.713956  933934 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:05.714202  933934 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:08.213553  933934 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:10.213661  933934 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:12.714548  933934 pod_ready.go:102] pod "kube-scheduler-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:14.213352  933934 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-069806" in "kube-system" namespace has status "Ready":"True"
	I0717 20:26:14.213379  933934 pod_ready.go:81] duration metric: took 19.005892685s for pod "kube-scheduler-old-k8s-version-069806" in "kube-system" namespace to be "Ready" ...
	I0717 20:26:14.213391  933934 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace to be "Ready" ...
	I0717 20:26:16.221414  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:18.719896  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:20.720706  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:23.220667  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:25.719491  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:27.719692  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:29.720184  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:32.220097  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:34.720328  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:37.219864  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:39.721375  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:42.226155  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:44.719617  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:46.719723  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:49.219313  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:51.220151  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:53.729226  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:56.220752  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:26:58.719408  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:00.720193  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:03.219886  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:05.220078  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:07.220203  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:09.720199  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:12.219965  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:14.719959  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:17.219762  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:19.220260  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:21.220661  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:23.220748  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:25.720106  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:28.220216  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:30.220441  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:32.719292  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:34.720242  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:36.720522  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:39.221433  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:41.720274  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:44.220184  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:46.724395  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:49.218938  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:51.219481  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:53.219983  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:55.220270  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:57.719497  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:27:59.720407  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:02.220190  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:04.720534  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:07.219134  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:09.719989  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:12.220145  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:14.719707  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:16.720325  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:18.722544  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:21.219697  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:23.719827  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:25.720412  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:28.219386  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:30.219889  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:32.226424  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:34.720444  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:36.720701  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:38.756765  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:41.225850  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:43.719944  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:45.720736  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:48.220347  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:50.220684  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:52.719868  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:54.720494  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:57.219972  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:28:59.720891  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:02.220407  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:04.719933  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:06.720421  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:09.230002  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:11.719629  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:13.720015  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:16.220492  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:18.719214  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:20.719473  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:22.719838  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:24.720250  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:27.219396  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:29.246976  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:31.720845  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:34.220992  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:36.225870  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:38.720593  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:41.219768  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:43.221273  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:45.222025  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:47.719568  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:49.720268  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:52.219872  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:54.719439  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:57.220414  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:29:59.232394  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:30:01.721527  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:30:04.220526  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:30:06.220767  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:30:08.719491  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:30:10.735195  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:30:13.221116  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:30:14.213455  933934 pod_ready.go:81] duration metric: took 4m0.000039803s for pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace to be "Ready" ...
	E0717 20:30:14.213486  933934 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
	I0717 20:30:14.213497  933934 pod_ready.go:38] duration metric: took 5m27.099755562s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0717 20:30:14.213513  933934 api_server.go:52] waiting for apiserver process to appear ...
	I0717 20:30:14.213547  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0717 20:30:14.213608  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0717 20:30:14.267329  933934 cri.go:89] found id: "cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c"
	I0717 20:30:14.267350  933934 cri.go:89] found id: "f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc"
	I0717 20:30:14.267356  933934 cri.go:89] found id: ""
	I0717 20:30:14.267364  933934 logs.go:276] 2 containers: [cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc]
	I0717 20:30:14.267435  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.279495  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.283694  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0717 20:30:14.283767  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0717 20:30:14.332584  933934 cri.go:89] found id: "687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c"
	I0717 20:30:14.332625  933934 cri.go:89] found id: "e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1"
	I0717 20:30:14.332631  933934 cri.go:89] found id: ""
	I0717 20:30:14.332639  933934 logs.go:276] 2 containers: [687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1]
	I0717 20:30:14.332701  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.337032  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.341616  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0717 20:30:14.341702  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0717 20:30:14.416560  933934 cri.go:89] found id: "6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4"
	I0717 20:30:14.416585  933934 cri.go:89] found id: "03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294"
	I0717 20:30:14.416590  933934 cri.go:89] found id: ""
	I0717 20:30:14.416597  933934 logs.go:276] 2 containers: [6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4 03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294]
	I0717 20:30:14.416653  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.420874  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.426407  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0717 20:30:14.426493  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0717 20:30:14.474023  933934 cri.go:89] found id: "d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75"
	I0717 20:30:14.474043  933934 cri.go:89] found id: "bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef"
	I0717 20:30:14.474048  933934 cri.go:89] found id: ""
	I0717 20:30:14.474055  933934 logs.go:276] 2 containers: [d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75 bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef]
	I0717 20:30:14.474115  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.479393  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.483562  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0717 20:30:14.483645  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0717 20:30:14.546766  933934 cri.go:89] found id: "4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608"
	I0717 20:30:14.546789  933934 cri.go:89] found id: "3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4"
	I0717 20:30:14.546794  933934 cri.go:89] found id: ""
	I0717 20:30:14.546801  933934 logs.go:276] 2 containers: [4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608 3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4]
	I0717 20:30:14.546858  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.551041  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.555838  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0717 20:30:14.555914  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0717 20:30:14.607756  933934 cri.go:89] found id: "87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08"
	I0717 20:30:14.607786  933934 cri.go:89] found id: "fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f"
	I0717 20:30:14.607793  933934 cri.go:89] found id: ""
	I0717 20:30:14.607800  933934 logs.go:276] 2 containers: [87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08 fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f]
	I0717 20:30:14.607870  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.611951  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.615691  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I0717 20:30:14.615756  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0717 20:30:14.665764  933934 cri.go:89] found id: "1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874"
	I0717 20:30:14.665792  933934 cri.go:89] found id: "62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b"
	I0717 20:30:14.665797  933934 cri.go:89] found id: ""
	I0717 20:30:14.665805  933934 logs.go:276] 2 containers: [1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874 62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b]
	I0717 20:30:14.665859  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.672728  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.676956  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0717 20:30:14.677042  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0717 20:30:14.739516  933934 cri.go:89] found id: "57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0"
	I0717 20:30:14.739541  933934 cri.go:89] found id: "89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5"
	I0717 20:30:14.739562  933934 cri.go:89] found id: ""
	I0717 20:30:14.739570  933934 logs.go:276] 2 containers: [57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0 89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5]
	I0717 20:30:14.739628  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.743476  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.748788  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0717 20:30:14.748859  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0717 20:30:14.825367  933934 cri.go:89] found id: "44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1"
	I0717 20:30:14.825454  933934 cri.go:89] found id: ""
	I0717 20:30:14.825477  933934 logs.go:276] 1 containers: [44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1]
	I0717 20:30:14.825567  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.829469  933934 logs.go:123] Gathering logs for containerd ...
	I0717 20:30:14.829492  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0717 20:30:14.951471  933934 logs.go:123] Gathering logs for container status ...
	I0717 20:30:14.951551  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0717 20:30:15.002401  933934 logs.go:123] Gathering logs for describe nodes ...
	I0717 20:30:15.002553  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0717 20:30:15.257508  933934 logs.go:123] Gathering logs for kube-apiserver [f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc] ...
	I0717 20:30:15.257583  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc"
	I0717 20:30:15.326653  933934 logs.go:123] Gathering logs for etcd [687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c] ...
	I0717 20:30:15.326685  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c"
	I0717 20:30:15.396670  933934 logs.go:123] Gathering logs for etcd [e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1] ...
	I0717 20:30:15.396750  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1"
	I0717 20:30:15.473355  933934 logs.go:123] Gathering logs for kube-controller-manager [fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f] ...
	I0717 20:30:15.473711  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f"
	I0717 20:30:15.552525  933934 logs.go:123] Gathering logs for storage-provisioner [57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0] ...
	I0717 20:30:15.552603  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0"
	I0717 20:30:15.637695  933934 logs.go:123] Gathering logs for kindnet [62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b] ...
	I0717 20:30:15.637726  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b"
	I0717 20:30:15.746665  933934 logs.go:123] Gathering logs for kubelet ...
	I0717 20:30:15.746710  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0717 20:30:15.806130  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.042220     662 reflector.go:138] object-"kube-system"/"kube-proxy-token-7976r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-7976r" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.806356  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082566     662 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.806573  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082721     662 reflector.go:138] object-"kube-system"/"coredns-token-mrwzx": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-mrwzx" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.806781  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082802     662 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.807012  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082891     662 reflector.go:138] object-"kube-system"/"kindnet-token-g6tv7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-g6tv7" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.810861  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.202724     662 reflector.go:138] object-"kube-system"/"metrics-server-token-fksnv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-fksnv" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.811163  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.202810     662 reflector.go:138] object-"kube-system"/"storage-provisioner-token-rtf2k": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-rtf2k" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.811378  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.202881     662 reflector.go:138] object-"default"/"default-token-9ftpp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-9ftpp" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.819326  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:49 old-k8s-version-069806 kubelet[662]: E0717 20:24:49.183838     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:15.820329  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:50 old-k8s-version-069806 kubelet[662]: E0717 20:24:50.150410     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.823214  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:01 old-k8s-version-069806 kubelet[662]: E0717 20:25:01.900030     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:15.825532  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:11 old-k8s-version-069806 kubelet[662]: E0717 20:25:11.253734     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.825892  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:12 old-k8s-version-069806 kubelet[662]: E0717 20:25:12.256602     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.826084  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:12 old-k8s-version-069806 kubelet[662]: E0717 20:25:12.874626     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.826439  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:16 old-k8s-version-069806 kubelet[662]: E0717 20:25:16.266437     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.827342  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:20 old-k8s-version-069806 kubelet[662]: E0717 20:25:20.299236     662 pod_workers.go:191] Error syncing pod b733c4a6-f6de-426d-86c9-67948261d437 ("storage-provisioner_kube-system(b733c4a6-f6de-426d-86c9-67948261d437)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(b733c4a6-f6de-426d-86c9-67948261d437)"
	W0717 20:30:15.830056  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:27 old-k8s-version-069806 kubelet[662]: E0717 20:25:27.898396     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:15.831034  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:30 old-k8s-version-069806 kubelet[662]: E0717 20:25:30.313468     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.831554  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:36 old-k8s-version-069806 kubelet[662]: E0717 20:25:36.266512     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.831804  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:40 old-k8s-version-069806 kubelet[662]: E0717 20:25:40.874479     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.832142  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:51 old-k8s-version-069806 kubelet[662]: E0717 20:25:51.875881     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.832612  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:53 old-k8s-version-069806 kubelet[662]: E0717 20:25:53.400984     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.832942  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:56 old-k8s-version-069806 kubelet[662]: E0717 20:25:56.266353     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.833146  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:03 old-k8s-version-069806 kubelet[662]: E0717 20:26:03.874232     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.833523  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:09 old-k8s-version-069806 kubelet[662]: E0717 20:26:09.873806     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.836067  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:17 old-k8s-version-069806 kubelet[662]: E0717 20:26:17.885290     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:15.836428  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:21 old-k8s-version-069806 kubelet[662]: E0717 20:26:21.873819     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.836617  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:30 old-k8s-version-069806 kubelet[662]: E0717 20:26:30.874108     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.837267  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:37 old-k8s-version-069806 kubelet[662]: E0717 20:26:37.530420     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.837473  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:45 old-k8s-version-069806 kubelet[662]: E0717 20:26:45.874342     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.837808  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:46 old-k8s-version-069806 kubelet[662]: E0717 20:26:46.266436     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.838137  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:56 old-k8s-version-069806 kubelet[662]: E0717 20:26:56.873836     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.838324  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:00 old-k8s-version-069806 kubelet[662]: E0717 20:27:00.874137     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.838656  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:11 old-k8s-version-069806 kubelet[662]: E0717 20:27:11.873895     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.838842  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:13 old-k8s-version-069806 kubelet[662]: E0717 20:27:13.874116     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.839175  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:24 old-k8s-version-069806 kubelet[662]: E0717 20:27:24.873860     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.839382  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:28 old-k8s-version-069806 kubelet[662]: E0717 20:27:28.874119     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.839712  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:37 old-k8s-version-069806 kubelet[662]: E0717 20:27:37.874238     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.842301  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:41 old-k8s-version-069806 kubelet[662]: E0717 20:27:41.890695     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:15.842898  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:48 old-k8s-version-069806 kubelet[662]: E0717 20:27:48.873801     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.843101  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:56 old-k8s-version-069806 kubelet[662]: E0717 20:27:56.874330     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.843697  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:01 old-k8s-version-069806 kubelet[662]: E0717 20:28:01.743439     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.844026  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:06 old-k8s-version-069806 kubelet[662]: E0717 20:28:06.266883     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.844220  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:07 old-k8s-version-069806 kubelet[662]: E0717 20:28:07.874945     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.844574  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:19 old-k8s-version-069806 kubelet[662]: E0717 20:28:19.877659     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.844765  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:22 old-k8s-version-069806 kubelet[662]: E0717 20:28:22.874306     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.845161  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:33 old-k8s-version-069806 kubelet[662]: E0717 20:28:33.876747     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.845353  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:36 old-k8s-version-069806 kubelet[662]: E0717 20:28:36.874299     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.845696  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:46 old-k8s-version-069806 kubelet[662]: E0717 20:28:46.874249     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.845885  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:48 old-k8s-version-069806 kubelet[662]: E0717 20:28:48.874132     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.846215  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:58 old-k8s-version-069806 kubelet[662]: E0717 20:28:58.873786     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.846400  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:59 old-k8s-version-069806 kubelet[662]: E0717 20:28:59.874380     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.846728  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:11 old-k8s-version-069806 kubelet[662]: E0717 20:29:11.874254     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.846913  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:12 old-k8s-version-069806 kubelet[662]: E0717 20:29:12.874187     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.847274  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:26 old-k8s-version-069806 kubelet[662]: E0717 20:29:26.873840     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.847468  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:27 old-k8s-version-069806 kubelet[662]: E0717 20:29:27.875007     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.847853  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:38 old-k8s-version-069806 kubelet[662]: E0717 20:29:38.874336     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.848049  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:39 old-k8s-version-069806 kubelet[662]: E0717 20:29:39.874118     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.848393  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:49 old-k8s-version-069806 kubelet[662]: E0717 20:29:49.873788     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.848587  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:53 old-k8s-version-069806 kubelet[662]: E0717 20:29:53.876300     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.848920  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:02 old-k8s-version-069806 kubelet[662]: E0717 20:30:02.874275     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.849105  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:07 old-k8s-version-069806 kubelet[662]: E0717 20:30:07.874813     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.849436  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:14 old-k8s-version-069806 kubelet[662]: E0717 20:30:14.873785     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	I0717 20:30:15.849448  933934 logs.go:123] Gathering logs for coredns [6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4] ...
	I0717 20:30:15.849464  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4"
	I0717 20:30:15.925345  933934 logs.go:123] Gathering logs for kube-scheduler [d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75] ...
	I0717 20:30:15.925372  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75"
	I0717 20:30:15.979819  933934 logs.go:123] Gathering logs for kube-controller-manager [87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08] ...
	I0717 20:30:15.979850  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08"
	I0717 20:30:16.115833  933934 logs.go:123] Gathering logs for storage-provisioner [89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5] ...
	I0717 20:30:16.115883  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5"
	I0717 20:30:16.208534  933934 logs.go:123] Gathering logs for kubernetes-dashboard [44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1] ...
	I0717 20:30:16.208558  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1"
	I0717 20:30:16.281385  933934 logs.go:123] Gathering logs for kindnet [1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874] ...
	I0717 20:30:16.281410  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874"
	I0717 20:30:16.387166  933934 logs.go:123] Gathering logs for dmesg ...
	I0717 20:30:16.387204  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0717 20:30:16.451258  933934 logs.go:123] Gathering logs for kube-apiserver [cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c] ...
	I0717 20:30:16.451330  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c"
	I0717 20:30:16.530536  933934 logs.go:123] Gathering logs for coredns [03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294] ...
	I0717 20:30:16.530569  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294"
	I0717 20:30:16.587298  933934 logs.go:123] Gathering logs for kube-scheduler [bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef] ...
	I0717 20:30:16.587323  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef"
	I0717 20:30:16.653727  933934 logs.go:123] Gathering logs for kube-proxy [4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608] ...
	I0717 20:30:16.653809  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608"
	I0717 20:30:16.705193  933934 logs.go:123] Gathering logs for kube-proxy [3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4] ...
	I0717 20:30:16.705229  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4"
	I0717 20:30:16.766943  933934 out.go:304] Setting ErrFile to fd 2...
	I0717 20:30:16.766971  933934 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0717 20:30:16.767041  933934 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0717 20:30:16.767063  933934 out.go:239]   Jul 17 20:29:49 old-k8s-version-069806 kubelet[662]: E0717 20:29:49.873788     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	  Jul 17 20:29:49 old-k8s-version-069806 kubelet[662]: E0717 20:29:49.873788     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:16.767086  933934 out.go:239]   Jul 17 20:29:53 old-k8s-version-069806 kubelet[662]: E0717 20:29:53.876300     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Jul 17 20:29:53 old-k8s-version-069806 kubelet[662]: E0717 20:29:53.876300     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:16.767107  933934 out.go:239]   Jul 17 20:30:02 old-k8s-version-069806 kubelet[662]: E0717 20:30:02.874275     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	  Jul 17 20:30:02 old-k8s-version-069806 kubelet[662]: E0717 20:30:02.874275     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:16.767119  933934 out.go:239]   Jul 17 20:30:07 old-k8s-version-069806 kubelet[662]: E0717 20:30:07.874813     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Jul 17 20:30:07 old-k8s-version-069806 kubelet[662]: E0717 20:30:07.874813     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:16.767134  933934 out.go:239]   Jul 17 20:30:14 old-k8s-version-069806 kubelet[662]: E0717 20:30:14.873785     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	  Jul 17 20:30:14 old-k8s-version-069806 kubelet[662]: E0717 20:30:14.873785     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	I0717 20:30:16.767141  933934 out.go:304] Setting ErrFile to fd 2...
	I0717 20:30:16.767155  933934 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 20:30:26.768428  933934 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0717 20:30:26.788723  933934 api_server.go:72] duration metric: took 5m56.839602005s to wait for apiserver process to appear ...
	I0717 20:30:26.788747  933934 api_server.go:88] waiting for apiserver healthz status ...
	I0717 20:30:26.788782  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0717 20:30:26.788852  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0717 20:30:26.854663  933934 cri.go:89] found id: "cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c"
	I0717 20:30:26.854684  933934 cri.go:89] found id: "f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc"
	I0717 20:30:26.854699  933934 cri.go:89] found id: ""
	I0717 20:30:26.854706  933934 logs.go:276] 2 containers: [cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc]
	I0717 20:30:26.854760  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:26.859009  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:26.866186  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0717 20:30:26.866263  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0717 20:30:26.950492  933934 cri.go:89] found id: "687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c"
	I0717 20:30:26.950587  933934 cri.go:89] found id: "e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1"
	I0717 20:30:26.950628  933934 cri.go:89] found id: ""
	I0717 20:30:26.950673  933934 logs.go:276] 2 containers: [687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1]
	I0717 20:30:26.950792  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:26.957062  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:26.961377  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0717 20:30:26.961473  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0717 20:30:27.059207  933934 cri.go:89] found id: "6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4"
	I0717 20:30:27.059234  933934 cri.go:89] found id: "03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294"
	I0717 20:30:27.059245  933934 cri.go:89] found id: ""
	I0717 20:30:27.059261  933934 logs.go:276] 2 containers: [6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4 03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294]
	I0717 20:30:27.059365  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.067097  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.075702  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0717 20:30:27.075928  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0717 20:30:27.167718  933934 cri.go:89] found id: "d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75"
	I0717 20:30:27.167820  933934 cri.go:89] found id: "bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef"
	I0717 20:30:27.167851  933934 cri.go:89] found id: ""
	I0717 20:30:27.167885  933934 logs.go:276] 2 containers: [d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75 bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef]
	I0717 20:30:27.168019  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.178946  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.187082  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0717 20:30:27.187280  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0717 20:30:27.264168  933934 cri.go:89] found id: "4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608"
	I0717 20:30:27.264295  933934 cri.go:89] found id: "3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4"
	I0717 20:30:27.264323  933934 cri.go:89] found id: ""
	I0717 20:30:27.264369  933934 logs.go:276] 2 containers: [4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608 3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4]
	I0717 20:30:27.264494  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.271255  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.276920  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0717 20:30:27.277160  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0717 20:30:27.352163  933934 cri.go:89] found id: "87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08"
	I0717 20:30:27.352255  933934 cri.go:89] found id: "fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f"
	I0717 20:30:27.352279  933934 cri.go:89] found id: ""
	I0717 20:30:27.352338  933934 logs.go:276] 2 containers: [87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08 fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f]
	I0717 20:30:27.352453  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.367677  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.371311  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I0717 20:30:27.371398  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0717 20:30:27.429211  933934 cri.go:89] found id: "1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874"
	I0717 20:30:27.429289  933934 cri.go:89] found id: "62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b"
	I0717 20:30:27.429313  933934 cri.go:89] found id: ""
	I0717 20:30:27.429367  933934 logs.go:276] 2 containers: [1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874 62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b]
	I0717 20:30:27.429472  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.436626  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.440515  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0717 20:30:27.440675  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0717 20:30:27.514271  933934 cri.go:89] found id: "57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0"
	I0717 20:30:27.514316  933934 cri.go:89] found id: "89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5"
	I0717 20:30:27.514322  933934 cri.go:89] found id: ""
	I0717 20:30:27.514330  933934 logs.go:276] 2 containers: [57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0 89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5]
	I0717 20:30:27.514397  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.519671  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.525084  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0717 20:30:27.525187  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0717 20:30:27.589900  933934 cri.go:89] found id: "44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1"
	I0717 20:30:27.589925  933934 cri.go:89] found id: ""
	I0717 20:30:27.589933  933934 logs.go:276] 1 containers: [44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1]
	I0717 20:30:27.589997  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.596715  933934 logs.go:123] Gathering logs for describe nodes ...
	I0717 20:30:27.596747  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0717 20:30:27.947618  933934 logs.go:123] Gathering logs for kube-scheduler [d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75] ...
	I0717 20:30:27.947656  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75"
	I0717 20:30:28.092581  933934 logs.go:123] Gathering logs for kube-proxy [3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4] ...
	I0717 20:30:28.092616  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4"
	I0717 20:30:28.170361  933934 logs.go:123] Gathering logs for storage-provisioner [89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5] ...
	I0717 20:30:28.170432  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5"
	I0717 20:30:28.276709  933934 logs.go:123] Gathering logs for kube-proxy [4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608] ...
	I0717 20:30:28.276780  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608"
	I0717 20:30:28.344367  933934 logs.go:123] Gathering logs for kube-controller-manager [fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f] ...
	I0717 20:30:28.344447  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f"
	I0717 20:30:28.451110  933934 logs.go:123] Gathering logs for kindnet [1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874] ...
	I0717 20:30:28.451194  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874"
	I0717 20:30:28.542709  933934 logs.go:123] Gathering logs for kindnet [62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b] ...
	I0717 20:30:28.542802  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b"
	I0717 20:30:28.629609  933934 logs.go:123] Gathering logs for kubelet ...
	I0717 20:30:28.629687  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0717 20:30:28.722241  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.042220     662 reflector.go:138] object-"kube-system"/"kube-proxy-token-7976r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-7976r" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.722576  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082566     662 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.722820  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082721     662 reflector.go:138] object-"kube-system"/"coredns-token-mrwzx": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-mrwzx" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.723070  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082802     662 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.723310  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082891     662 reflector.go:138] object-"kube-system"/"kindnet-token-g6tv7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-g6tv7" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.727196  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.202724     662 reflector.go:138] object-"kube-system"/"metrics-server-token-fksnv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-fksnv" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.730359  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.202810     662 reflector.go:138] object-"kube-system"/"storage-provisioner-token-rtf2k": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-rtf2k" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.730625  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.202881     662 reflector.go:138] object-"default"/"default-token-9ftpp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-9ftpp" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.738782  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:49 old-k8s-version-069806 kubelet[662]: E0717 20:24:49.183838     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:28.745235  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:50 old-k8s-version-069806 kubelet[662]: E0717 20:24:50.150410     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.748361  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:01 old-k8s-version-069806 kubelet[662]: E0717 20:25:01.900030     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:28.750574  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:11 old-k8s-version-069806 kubelet[662]: E0717 20:25:11.253734     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.755725  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:12 old-k8s-version-069806 kubelet[662]: E0717 20:25:12.256602     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.755972  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:12 old-k8s-version-069806 kubelet[662]: E0717 20:25:12.874626     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.756377  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:16 old-k8s-version-069806 kubelet[662]: E0717 20:25:16.266437     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.757278  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:20 old-k8s-version-069806 kubelet[662]: E0717 20:25:20.299236     662 pod_workers.go:191] Error syncing pod b733c4a6-f6de-426d-86c9-67948261d437 ("storage-provisioner_kube-system(b733c4a6-f6de-426d-86c9-67948261d437)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(b733c4a6-f6de-426d-86c9-67948261d437)"
	W0717 20:30:28.760001  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:27 old-k8s-version-069806 kubelet[662]: E0717 20:25:27.898396     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:28.761036  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:30 old-k8s-version-069806 kubelet[662]: E0717 20:25:30.313468     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.761536  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:36 old-k8s-version-069806 kubelet[662]: E0717 20:25:36.266512     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.761749  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:40 old-k8s-version-069806 kubelet[662]: E0717 20:25:40.874479     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.762116  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:51 old-k8s-version-069806 kubelet[662]: E0717 20:25:51.875881     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.762616  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:53 old-k8s-version-069806 kubelet[662]: E0717 20:25:53.400984     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.762983  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:56 old-k8s-version-069806 kubelet[662]: E0717 20:25:56.266353     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.763201  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:03 old-k8s-version-069806 kubelet[662]: E0717 20:26:03.874232     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.763561  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:09 old-k8s-version-069806 kubelet[662]: E0717 20:26:09.873806     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.769545  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:17 old-k8s-version-069806 kubelet[662]: E0717 20:26:17.885290     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:28.769933  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:21 old-k8s-version-069806 kubelet[662]: E0717 20:26:21.873819     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.770148  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:30 old-k8s-version-069806 kubelet[662]: E0717 20:26:30.874108     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.770789  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:37 old-k8s-version-069806 kubelet[662]: E0717 20:26:37.530420     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.771010  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:45 old-k8s-version-069806 kubelet[662]: E0717 20:26:45.874342     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.771386  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:46 old-k8s-version-069806 kubelet[662]: E0717 20:26:46.266436     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.771754  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:56 old-k8s-version-069806 kubelet[662]: E0717 20:26:56.873836     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.771969  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:00 old-k8s-version-069806 kubelet[662]: E0717 20:27:00.874137     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.772350  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:11 old-k8s-version-069806 kubelet[662]: E0717 20:27:11.873895     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.772565  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:13 old-k8s-version-069806 kubelet[662]: E0717 20:27:13.874116     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.772943  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:24 old-k8s-version-069806 kubelet[662]: E0717 20:27:24.873860     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.773157  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:28 old-k8s-version-069806 kubelet[662]: E0717 20:27:28.874119     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.773519  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:37 old-k8s-version-069806 kubelet[662]: E0717 20:27:37.874238     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.776173  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:41 old-k8s-version-069806 kubelet[662]: E0717 20:27:41.890695     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:28.776548  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:48 old-k8s-version-069806 kubelet[662]: E0717 20:27:48.873801     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.776763  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:56 old-k8s-version-069806 kubelet[662]: E0717 20:27:56.874330     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.777477  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:01 old-k8s-version-069806 kubelet[662]: E0717 20:28:01.743439     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.777845  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:06 old-k8s-version-069806 kubelet[662]: E0717 20:28:06.266883     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.778060  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:07 old-k8s-version-069806 kubelet[662]: E0717 20:28:07.874945     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.778428  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:19 old-k8s-version-069806 kubelet[662]: E0717 20:28:19.877659     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.778647  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:22 old-k8s-version-069806 kubelet[662]: E0717 20:28:22.874306     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.779018  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:33 old-k8s-version-069806 kubelet[662]: E0717 20:28:33.876747     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.779245  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:36 old-k8s-version-069806 kubelet[662]: E0717 20:28:36.874299     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.779617  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:46 old-k8s-version-069806 kubelet[662]: E0717 20:28:46.874249     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.779835  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:48 old-k8s-version-069806 kubelet[662]: E0717 20:28:48.874132     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.780232  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:58 old-k8s-version-069806 kubelet[662]: E0717 20:28:58.873786     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.780448  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:59 old-k8s-version-069806 kubelet[662]: E0717 20:28:59.874380     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.780808  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:11 old-k8s-version-069806 kubelet[662]: E0717 20:29:11.874254     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.781029  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:12 old-k8s-version-069806 kubelet[662]: E0717 20:29:12.874187     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.781398  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:26 old-k8s-version-069806 kubelet[662]: E0717 20:29:26.873840     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.781614  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:27 old-k8s-version-069806 kubelet[662]: E0717 20:29:27.875007     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.781979  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:38 old-k8s-version-069806 kubelet[662]: E0717 20:29:38.874336     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.782198  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:39 old-k8s-version-069806 kubelet[662]: E0717 20:29:39.874118     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.782564  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:49 old-k8s-version-069806 kubelet[662]: E0717 20:29:49.873788     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.782843  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:53 old-k8s-version-069806 kubelet[662]: E0717 20:29:53.876300     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.783215  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:02 old-k8s-version-069806 kubelet[662]: E0717 20:30:02.874275     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.783432  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:07 old-k8s-version-069806 kubelet[662]: E0717 20:30:07.874813     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.783792  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:14 old-k8s-version-069806 kubelet[662]: E0717 20:30:14.873785     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.786430  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:22 old-k8s-version-069806 kubelet[662]: E0717 20:30:22.883566     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:28.786798  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:25 old-k8s-version-069806 kubelet[662]: E0717 20:30:25.883025     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	I0717 20:30:28.786828  933934 logs.go:123] Gathering logs for coredns [6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4] ...
	I0717 20:30:28.786863  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4"
	I0717 20:30:28.833770  933934 logs.go:123] Gathering logs for coredns [03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294] ...
	I0717 20:30:28.833849  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294"
	I0717 20:30:28.895551  933934 logs.go:123] Gathering logs for kube-scheduler [bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef] ...
	I0717 20:30:28.895628  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef"
	I0717 20:30:28.995745  933934 logs.go:123] Gathering logs for containerd ...
	I0717 20:30:28.995823  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0717 20:30:29.100068  933934 logs.go:123] Gathering logs for dmesg ...
	I0717 20:30:29.100146  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0717 20:30:29.125900  933934 logs.go:123] Gathering logs for kube-apiserver [cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c] ...
	I0717 20:30:29.126061  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c"
	I0717 20:30:29.268391  933934 logs.go:123] Gathering logs for etcd [e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1] ...
	I0717 20:30:29.268472  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1"
	I0717 20:30:29.345202  933934 logs.go:123] Gathering logs for kube-controller-manager [87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08] ...
	I0717 20:30:29.345282  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08"
	I0717 20:30:29.445718  933934 logs.go:123] Gathering logs for container status ...
	I0717 20:30:29.445797  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0717 20:30:29.515085  933934 logs.go:123] Gathering logs for kube-apiserver [f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc] ...
	I0717 20:30:29.515163  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc"
	I0717 20:30:29.590224  933934 logs.go:123] Gathering logs for etcd [687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c] ...
	I0717 20:30:29.590313  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c"
	I0717 20:30:29.682136  933934 logs.go:123] Gathering logs for storage-provisioner [57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0] ...
	I0717 20:30:29.682207  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0"
	I0717 20:30:29.861255  933934 logs.go:123] Gathering logs for kubernetes-dashboard [44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1] ...
	I0717 20:30:29.861335  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1"
	I0717 20:30:30.009936  933934 out.go:304] Setting ErrFile to fd 2...
	I0717 20:30:30.010027  933934 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0717 20:30:30.010116  933934 out.go:239] X Problems detected in kubelet:
	X Problems detected in kubelet:
	W0717 20:30:30.010456  933934 out.go:239]   Jul 17 20:30:02 old-k8s-version-069806 kubelet[662]: E0717 20:30:02.874275     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	  Jul 17 20:30:02 old-k8s-version-069806 kubelet[662]: E0717 20:30:02.874275     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:30.010578  933934 out.go:239]   Jul 17 20:30:07 old-k8s-version-069806 kubelet[662]: E0717 20:30:07.874813     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	  Jul 17 20:30:07 old-k8s-version-069806 kubelet[662]: E0717 20:30:07.874813     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:30.010645  933934 out.go:239]   Jul 17 20:30:14 old-k8s-version-069806 kubelet[662]: E0717 20:30:14.873785     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	  Jul 17 20:30:14 old-k8s-version-069806 kubelet[662]: E0717 20:30:14.873785     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:30.010680  933934 out.go:239]   Jul 17 20:30:22 old-k8s-version-069806 kubelet[662]: E0717 20:30:22.883566     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	  Jul 17 20:30:22 old-k8s-version-069806 kubelet[662]: E0717 20:30:22.883566     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:30.010757  933934 out.go:239]   Jul 17 20:30:25 old-k8s-version-069806 kubelet[662]: E0717 20:30:25.883025     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	  Jul 17 20:30:25 old-k8s-version-069806 kubelet[662]: E0717 20:30:25.883025     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	I0717 20:30:30.010795  933934 out.go:304] Setting ErrFile to fd 2...
	I0717 20:30:30.010911  933934 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 20:30:40.013310  933934 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0717 20:30:40.037373  933934 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0717 20:30:40.040368  933934 out.go:177] 
	W0717 20:30:40.043794  933934 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	W0717 20:30:40.043842  933934 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
	* Suggestion: Control Plane could not update, try minikube delete --all --purge
	W0717 20:30:40.043863  933934 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
	* Related issue: https://github.com/kubernetes/minikube/issues/11417
	W0717 20:30:40.043869  933934 out.go:239] * 
	* 
	W0717 20:30:40.044970  933934 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0717 20:30:40.055997  933934 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-linux-arm64 start -p old-k8s-version-069806 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0": exit status 102
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect old-k8s-version-069806
helpers_test.go:235: (dbg) docker inspect old-k8s-version-069806:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "97b861eb6dc5d52b0fded597c9871fb26944e5dabef537738c7addf687d7c709",
	        "Created": "2024-07-17T20:21:10.876011032Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 934149,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2024-07-17T20:24:22.947859305Z",
	            "FinishedAt": "2024-07-17T20:24:21.796731447Z"
	        },
	        "Image": "sha256:a11bb5e2546f3ca503b3c47550c3b044149515e29579deea734475d97cc9a2be",
	        "ResolvConfPath": "/var/lib/docker/containers/97b861eb6dc5d52b0fded597c9871fb26944e5dabef537738c7addf687d7c709/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/97b861eb6dc5d52b0fded597c9871fb26944e5dabef537738c7addf687d7c709/hostname",
	        "HostsPath": "/var/lib/docker/containers/97b861eb6dc5d52b0fded597c9871fb26944e5dabef537738c7addf687d7c709/hosts",
	        "LogPath": "/var/lib/docker/containers/97b861eb6dc5d52b0fded597c9871fb26944e5dabef537738c7addf687d7c709/97b861eb6dc5d52b0fded597c9871fb26944e5dabef537738c7addf687d7c709-json.log",
	        "Name": "/old-k8s-version-069806",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "old-k8s-version-069806:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "old-k8s-version-069806",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/d27b6d411e1237693fc08a11515df81b6e3cbe75df8633a394679e973b33f9be-init/diff:/var/lib/docker/overlay2/330a017725679c1db133a0ed13915b02cfa1878fbe6c4ab5849ef9b0af25d1ee/diff",
	                "MergedDir": "/var/lib/docker/overlay2/d27b6d411e1237693fc08a11515df81b6e3cbe75df8633a394679e973b33f9be/merged",
	                "UpperDir": "/var/lib/docker/overlay2/d27b6d411e1237693fc08a11515df81b6e3cbe75df8633a394679e973b33f9be/diff",
	                "WorkDir": "/var/lib/docker/overlay2/d27b6d411e1237693fc08a11515df81b6e3cbe75df8633a394679e973b33f9be/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "old-k8s-version-069806",
	                "Source": "/var/lib/docker/volumes/old-k8s-version-069806/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "old-k8s-version-069806",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "old-k8s-version-069806",
	                "name.minikube.sigs.k8s.io": "old-k8s-version-069806",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "32d379803ca89248da8d7d7ee2997c567f86eeddc7476301fdfe1cf7e167795f",
	            "SandboxKey": "/var/run/docker/netns/32d379803ca8",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33824"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33825"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33828"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33826"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33827"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "old-k8s-version-069806": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.76.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "02:42:c0:a8:4c:02",
	                    "DriverOpts": null,
	                    "NetworkID": "6269ce15976b3fb39eecf0ecfe5482225a9efe38ae5bc9d37d8bff293a8a3ff8",
	                    "EndpointID": "7db2b2710e65d4bff245b00be494c93c32422fc2508c6e42b06d493821f25cec",
	                    "Gateway": "192.168.76.1",
	                    "IPAddress": "192.168.76.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "old-k8s-version-069806",
	                        "97b861eb6dc5"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-069806 -n old-k8s-version-069806
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p old-k8s-version-069806 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p old-k8s-version-069806 logs -n 25: (2.298861156s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/SecondStart logs: 
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
	| Command |                          Args                          |         Profile          |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
	| start   | -p cert-expiration-125673                              | cert-expiration-125673   | jenkins | v1.33.1 | 17 Jul 24 20:19 UTC | 17 Jul 24 20:20 UTC |
	|         | --memory=2048                                          |                          |         |         |                     |                     |
	|         | --cert-expiration=3m                                   |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	| ssh     | force-systemd-env-336096                               | force-systemd-env-336096 | jenkins | v1.33.1 | 17 Jul 24 20:20 UTC | 17 Jul 24 20:20 UTC |
	|         | ssh cat                                                |                          |         |         |                     |                     |
	|         | /etc/containerd/config.toml                            |                          |         |         |                     |                     |
	| delete  | -p force-systemd-env-336096                            | force-systemd-env-336096 | jenkins | v1.33.1 | 17 Jul 24 20:20 UTC | 17 Jul 24 20:20 UTC |
	| start   | -p cert-options-693725                                 | cert-options-693725      | jenkins | v1.33.1 | 17 Jul 24 20:20 UTC | 17 Jul 24 20:21 UTC |
	|         | --memory=2048                                          |                          |         |         |                     |                     |
	|         | --apiserver-ips=127.0.0.1                              |                          |         |         |                     |                     |
	|         | --apiserver-ips=192.168.15.15                          |                          |         |         |                     |                     |
	|         | --apiserver-names=localhost                            |                          |         |         |                     |                     |
	|         | --apiserver-names=www.google.com                       |                          |         |         |                     |                     |
	|         | --apiserver-port=8555                                  |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	| ssh     | cert-options-693725 ssh                                | cert-options-693725      | jenkins | v1.33.1 | 17 Jul 24 20:21 UTC | 17 Jul 24 20:21 UTC |
	|         | openssl x509 -text -noout -in                          |                          |         |         |                     |                     |
	|         | /var/lib/minikube/certs/apiserver.crt                  |                          |         |         |                     |                     |
	| ssh     | -p cert-options-693725 -- sudo                         | cert-options-693725      | jenkins | v1.33.1 | 17 Jul 24 20:21 UTC | 17 Jul 24 20:21 UTC |
	|         | cat /etc/kubernetes/admin.conf                         |                          |         |         |                     |                     |
	| delete  | -p cert-options-693725                                 | cert-options-693725      | jenkins | v1.33.1 | 17 Jul 24 20:21 UTC | 17 Jul 24 20:21 UTC |
	| start   | -p old-k8s-version-069806                              | old-k8s-version-069806   | jenkins | v1.33.1 | 17 Jul 24 20:21 UTC | 17 Jul 24 20:23 UTC |
	|         | --memory=2200                                          |                          |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                          |         |         |                     |                     |
	|         | --kvm-network=default                                  |                          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                          |                          |         |         |                     |                     |
	|         | --disable-driver-mounts                                |                          |         |         |                     |                     |
	|         | --keep-context=false                                   |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                           |                          |         |         |                     |                     |
	| start   | -p cert-expiration-125673                              | cert-expiration-125673   | jenkins | v1.33.1 | 17 Jul 24 20:23 UTC | 17 Jul 24 20:23 UTC |
	|         | --memory=2048                                          |                          |         |         |                     |                     |
	|         | --cert-expiration=8760h                                |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	| delete  | -p cert-expiration-125673                              | cert-expiration-125673   | jenkins | v1.33.1 | 17 Jul 24 20:23 UTC | 17 Jul 24 20:23 UTC |
	| start   | -p no-preload-385299 --memory=2200                     | no-preload-385299        | jenkins | v1.33.1 | 17 Jul 24 20:23 UTC | 17 Jul 24 20:24 UTC |
	|         | --alsologtostderr --wait=true                          |                          |         |         |                     |                     |
	|         | --preload=false --driver=docker                        |                          |         |         |                     |                     |
	|         |  --container-runtime=containerd                        |                          |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0-beta.0                    |                          |         |         |                     |                     |
	| addons  | enable metrics-server -p old-k8s-version-069806        | old-k8s-version-069806   | jenkins | v1.33.1 | 17 Jul 24 20:24 UTC | 17 Jul 24 20:24 UTC |
	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                 |                          |         |         |                     |                     |
	| stop    | -p old-k8s-version-069806                              | old-k8s-version-069806   | jenkins | v1.33.1 | 17 Jul 24 20:24 UTC | 17 Jul 24 20:24 UTC |
	|         | --alsologtostderr -v=3                                 |                          |         |         |                     |                     |
	| addons  | enable dashboard -p old-k8s-version-069806             | old-k8s-version-069806   | jenkins | v1.33.1 | 17 Jul 24 20:24 UTC | 17 Jul 24 20:24 UTC |
	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                          |         |         |                     |                     |
	| start   | -p old-k8s-version-069806                              | old-k8s-version-069806   | jenkins | v1.33.1 | 17 Jul 24 20:24 UTC |                     |
	|         | --memory=2200                                          |                          |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                          |         |         |                     |                     |
	|         | --kvm-network=default                                  |                          |         |         |                     |                     |
	|         | --kvm-qemu-uri=qemu:///system                          |                          |         |         |                     |                     |
	|         | --disable-driver-mounts                                |                          |         |         |                     |                     |
	|         | --keep-context=false                                   |                          |         |         |                     |                     |
	|         | --driver=docker                                        |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                           |                          |         |         |                     |                     |
	| addons  | enable metrics-server -p no-preload-385299             | no-preload-385299        | jenkins | v1.33.1 | 17 Jul 24 20:25 UTC | 17 Jul 24 20:25 UTC |
	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                          |         |         |                     |                     |
	|         | --registries=MetricsServer=fake.domain                 |                          |         |         |                     |                     |
	| stop    | -p no-preload-385299                                   | no-preload-385299        | jenkins | v1.33.1 | 17 Jul 24 20:25 UTC | 17 Jul 24 20:25 UTC |
	|         | --alsologtostderr -v=3                                 |                          |         |         |                     |                     |
	| addons  | enable dashboard -p no-preload-385299                  | no-preload-385299        | jenkins | v1.33.1 | 17 Jul 24 20:25 UTC | 17 Jul 24 20:25 UTC |
	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                          |         |         |                     |                     |
	| start   | -p no-preload-385299 --memory=2200                     | no-preload-385299        | jenkins | v1.33.1 | 17 Jul 24 20:25 UTC | 17 Jul 24 20:29 UTC |
	|         | --alsologtostderr --wait=true                          |                          |         |         |                     |                     |
	|         | --preload=false --driver=docker                        |                          |         |         |                     |                     |
	|         |  --container-runtime=containerd                        |                          |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0-beta.0                    |                          |         |         |                     |                     |
	| image   | no-preload-385299 image list                           | no-preload-385299        | jenkins | v1.33.1 | 17 Jul 24 20:29 UTC | 17 Jul 24 20:29 UTC |
	|         | --format=json                                          |                          |         |         |                     |                     |
	| pause   | -p no-preload-385299                                   | no-preload-385299        | jenkins | v1.33.1 | 17 Jul 24 20:29 UTC | 17 Jul 24 20:29 UTC |
	|         | --alsologtostderr -v=1                                 |                          |         |         |                     |                     |
	| unpause | -p no-preload-385299                                   | no-preload-385299        | jenkins | v1.33.1 | 17 Jul 24 20:29 UTC | 17 Jul 24 20:29 UTC |
	|         | --alsologtostderr -v=1                                 |                          |         |         |                     |                     |
	| delete  | -p no-preload-385299                                   | no-preload-385299        | jenkins | v1.33.1 | 17 Jul 24 20:29 UTC | 17 Jul 24 20:30 UTC |
	| delete  | -p no-preload-385299                                   | no-preload-385299        | jenkins | v1.33.1 | 17 Jul 24 20:30 UTC | 17 Jul 24 20:30 UTC |
	| start   | -p embed-certs-195036                                  | embed-certs-195036       | jenkins | v1.33.1 | 17 Jul 24 20:30 UTC |                     |
	|         | --memory=2200                                          |                          |         |         |                     |                     |
	|         | --alsologtostderr --wait=true                          |                          |         |         |                     |                     |
	|         | --embed-certs --driver=docker                          |                          |         |         |                     |                     |
	|         | --container-runtime=containerd                         |                          |         |         |                     |                     |
	|         | --kubernetes-version=v1.30.2                           |                          |         |         |                     |                     |
	|---------|--------------------------------------------------------|--------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/07/17 20:30:02
	Running on machine: ip-172-31-30-239
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0717 20:30:02.169976  944109 out.go:291] Setting OutFile to fd 1 ...
	I0717 20:30:02.170170  944109 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 20:30:02.170199  944109 out.go:304] Setting ErrFile to fd 2...
	I0717 20:30:02.170220  944109 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 20:30:02.170486  944109 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
	I0717 20:30:02.170962  944109 out.go:298] Setting JSON to false
	I0717 20:30:02.172085  944109 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":15150,"bootTime":1721233052,"procs":224,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0717 20:30:02.172188  944109 start.go:139] virtualization:  
	I0717 20:30:02.174743  944109 out.go:177] * [embed-certs-195036] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0717 20:30:02.176867  944109 out.go:177]   - MINIKUBE_LOCATION=19282
	I0717 20:30:02.176995  944109 notify.go:220] Checking for updates...
	I0717 20:30:02.180897  944109 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 20:30:02.182943  944109 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig
	I0717 20:30:02.184655  944109 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube
	I0717 20:30:02.186685  944109 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0717 20:30:02.188718  944109 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0717 20:30:02.191172  944109 config.go:182] Loaded profile config "old-k8s-version-069806": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.20.0
	I0717 20:30:02.191315  944109 driver.go:392] Setting default libvirt URI to qemu:///system
	I0717 20:30:02.228271  944109 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0717 20:30:02.228477  944109 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:30:02.304980  944109 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-17 20:30:02.281392764 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0717 20:30:02.305093  944109 docker.go:307] overlay module found
	I0717 20:30:02.307431  944109 out.go:177] * Using the docker driver based on user configuration
	I0717 20:29:59.232394  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:30:01.721527  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:30:02.309388  944109 start.go:297] selected driver: docker
	I0717 20:30:02.309417  944109 start.go:901] validating driver "docker" against <nil>
	I0717 20:30:02.309434  944109 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0717 20:30:02.310174  944109 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:30:02.372228  944109 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:34 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-17 20:30:02.36278293 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aarc
h64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0717 20:30:02.372393  944109 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0717 20:30:02.372622  944109 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0717 20:30:02.374731  944109 out.go:177] * Using Docker driver with root privileges
	I0717 20:30:02.376559  944109 cni.go:84] Creating CNI manager for ""
	I0717 20:30:02.376582  944109 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 20:30:02.376591  944109 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0717 20:30:02.376685  944109 start.go:340] cluster config:
	{Name:embed-certs-195036 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:embed-certs-195036 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contain
erRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Stati
cIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0717 20:30:02.378795  944109 out.go:177] * Starting "embed-certs-195036" primary control-plane node in "embed-certs-195036" cluster
	I0717 20:30:02.380895  944109 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0717 20:30:02.382800  944109 out.go:177] * Pulling base image v0.0.44-1721234491-19282 ...
	I0717 20:30:02.384883  944109 preload.go:131] Checking if preload exists for k8s version v1.30.2 and runtime containerd
	I0717 20:30:02.384942  944109 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19282-720845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-containerd-overlay2-arm64.tar.lz4
	I0717 20:30:02.384956  944109 cache.go:56] Caching tarball of preloaded images
	I0717 20:30:02.384954  944109 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 in local docker daemon
	I0717 20:30:02.385038  944109 preload.go:172] Found /home/jenkins/minikube-integration/19282-720845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I0717 20:30:02.385049  944109 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on containerd
	I0717 20:30:02.385157  944109 profile.go:143] Saving config to /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/config.json ...
	I0717 20:30:02.385185  944109 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/config.json: {Name:mkf90a5fa2b55bace698c558a372a10c21691737 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	W0717 20:30:02.403735  944109 image.go:95] image gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 is of wrong architecture
	I0717 20:30:02.403760  944109 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 to local cache
	I0717 20:30:02.403859  944109 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 in local cache directory
	I0717 20:30:02.403883  944109 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 in local cache directory, skipping pull
	I0717 20:30:02.403888  944109 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 exists in cache, skipping pull
	I0717 20:30:02.403899  944109 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 as a tarball
	I0717 20:30:02.403905  944109 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 from local cache
	I0717 20:30:02.519343  944109 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 from cached tarball
	I0717 20:30:02.519379  944109 cache.go:194] Successfully downloaded all kic artifacts
	I0717 20:30:02.519419  944109 start.go:360] acquireMachinesLock for embed-certs-195036: {Name:mkdf09256bae7a80bad05ba6bb7a7384a3eb96c5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0717 20:30:02.520092  944109 start.go:364] duration metric: took 650.791µs to acquireMachinesLock for "embed-certs-195036"
	I0717 20:30:02.520138  944109 start.go:93] Provisioning new machine with config: &{Name:embed-certs-195036 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:embed-certs-195036 Namespace:default APIServerHAVIP: APIServe
rName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0717 20:30:02.520231  944109 start.go:125] createHost starting for "" (driver="docker")
	I0717 20:30:02.524639  944109 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
	I0717 20:30:02.524961  944109 start.go:159] libmachine.API.Create for "embed-certs-195036" (driver="docker")
	I0717 20:30:02.525008  944109 client.go:168] LocalClient.Create starting
	I0717 20:30:02.525100  944109 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca.pem
	I0717 20:30:02.525142  944109 main.go:141] libmachine: Decoding PEM data...
	I0717 20:30:02.525165  944109 main.go:141] libmachine: Parsing certificate...
	I0717 20:30:02.525236  944109 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19282-720845/.minikube/certs/cert.pem
	I0717 20:30:02.525278  944109 main.go:141] libmachine: Decoding PEM data...
	I0717 20:30:02.525294  944109 main.go:141] libmachine: Parsing certificate...
	I0717 20:30:02.525725  944109 cli_runner.go:164] Run: docker network inspect embed-certs-195036 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0717 20:30:02.542943  944109 cli_runner.go:211] docker network inspect embed-certs-195036 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0717 20:30:02.543052  944109 network_create.go:284] running [docker network inspect embed-certs-195036] to gather additional debugging logs...
	I0717 20:30:02.543084  944109 cli_runner.go:164] Run: docker network inspect embed-certs-195036
	W0717 20:30:02.558188  944109 cli_runner.go:211] docker network inspect embed-certs-195036 returned with exit code 1
	I0717 20:30:02.558223  944109 network_create.go:287] error running [docker network inspect embed-certs-195036]: docker network inspect embed-certs-195036: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network embed-certs-195036 not found
	I0717 20:30:02.558237  944109 network_create.go:289] output of [docker network inspect embed-certs-195036]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network embed-certs-195036 not found
	
	** /stderr **
	I0717 20:30:02.558335  944109 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0717 20:30:02.575032  944109 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-33e3147793ea IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:d4:90:4a:d8} reservation:<nil>}
	I0717 20:30:02.575600  944109 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-798078d9c1d4 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:fc:ef:a4:0a} reservation:<nil>}
	I0717 20:30:02.576349  944109 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-8f81f57b47a2 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:70:53:0f:59} reservation:<nil>}
	I0717 20:30:02.576742  944109 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-6269ce15976b IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:02:42:34:64:3b:70} reservation:<nil>}
	I0717 20:30:02.577303  944109 network.go:206] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40018b2000}
	I0717 20:30:02.577352  944109 network_create.go:124] attempt to create docker network embed-certs-195036 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
	I0717 20:30:02.577436  944109 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=embed-certs-195036 embed-certs-195036
	I0717 20:30:02.652546  944109 network_create.go:108] docker network embed-certs-195036 192.168.85.0/24 created
	I0717 20:30:02.652580  944109 kic.go:121] calculated static IP "192.168.85.2" for the "embed-certs-195036" container
	I0717 20:30:02.652655  944109 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0717 20:30:02.668571  944109 cli_runner.go:164] Run: docker volume create embed-certs-195036 --label name.minikube.sigs.k8s.io=embed-certs-195036 --label created_by.minikube.sigs.k8s.io=true
	I0717 20:30:02.686145  944109 oci.go:103] Successfully created a docker volume embed-certs-195036
	I0717 20:30:02.686237  944109 cli_runner.go:164] Run: docker run --rm --name embed-certs-195036-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-195036 --entrypoint /usr/bin/test -v embed-certs-195036:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 -d /var/lib
	I0717 20:30:03.335708  944109 oci.go:107] Successfully prepared a docker volume embed-certs-195036
	I0717 20:30:03.335757  944109 preload.go:131] Checking if preload exists for k8s version v1.30.2 and runtime containerd
	I0717 20:30:03.335778  944109 kic.go:194] Starting extracting preloaded images to volume ...
	I0717 20:30:03.335860  944109 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19282-720845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-195036:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 -I lz4 -xf /preloaded.tar -C /extractDir
	I0717 20:30:04.220526  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:30:06.220767  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:30:09.277556  944109 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19282-720845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v embed-certs-195036:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 -I lz4 -xf /preloaded.tar -C /extractDir: (5.94165205s)
	I0717 20:30:09.277587  944109 kic.go:203] duration metric: took 5.941805868s to extract preloaded images to volume ...
	W0717 20:30:09.277716  944109 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0717 20:30:09.277818  944109 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0717 20:30:09.328684  944109 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-195036 --name embed-certs-195036 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-195036 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-195036 --network embed-certs-195036 --ip 192.168.85.2 --volume embed-certs-195036:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2
	I0717 20:30:09.711866  944109 cli_runner.go:164] Run: docker container inspect embed-certs-195036 --format={{.State.Running}}
	I0717 20:30:09.737804  944109 cli_runner.go:164] Run: docker container inspect embed-certs-195036 --format={{.State.Status}}
	I0717 20:30:09.756847  944109 cli_runner.go:164] Run: docker exec embed-certs-195036 stat /var/lib/dpkg/alternatives/iptables
	I0717 20:30:09.833532  944109 oci.go:144] the created container "embed-certs-195036" has a running status.
	I0717 20:30:09.833560  944109 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19282-720845/.minikube/machines/embed-certs-195036/id_rsa...
	I0717 20:30:10.834162  944109 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19282-720845/.minikube/machines/embed-certs-195036/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0717 20:30:10.857769  944109 cli_runner.go:164] Run: docker container inspect embed-certs-195036 --format={{.State.Status}}
	I0717 20:30:10.878824  944109 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0717 20:30:10.878842  944109 kic_runner.go:114] Args: [docker exec --privileged embed-certs-195036 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0717 20:30:10.934276  944109 cli_runner.go:164] Run: docker container inspect embed-certs-195036 --format={{.State.Status}}
	I0717 20:30:10.953202  944109 machine.go:94] provisionDockerMachine start ...
	I0717 20:30:10.953322  944109 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-195036
	I0717 20:30:10.976214  944109 main.go:141] libmachine: Using SSH client type: native
	I0717 20:30:10.976494  944109 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2c70] 0x3e54d0 <nil>  [] 0s} 127.0.0.1 33834 <nil> <nil>}
	I0717 20:30:10.976504  944109 main.go:141] libmachine: About to run SSH command:
	hostname
	I0717 20:30:11.108928  944109 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-195036
	
	I0717 20:30:11.109007  944109 ubuntu.go:169] provisioning hostname "embed-certs-195036"
	I0717 20:30:11.109131  944109 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-195036
	I0717 20:30:11.137873  944109 main.go:141] libmachine: Using SSH client type: native
	I0717 20:30:11.138107  944109 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2c70] 0x3e54d0 <nil>  [] 0s} 127.0.0.1 33834 <nil> <nil>}
	I0717 20:30:11.138134  944109 main.go:141] libmachine: About to run SSH command:
	sudo hostname embed-certs-195036 && echo "embed-certs-195036" | sudo tee /etc/hostname
	I0717 20:30:11.298277  944109 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-195036
	
	I0717 20:30:11.298365  944109 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-195036
	I0717 20:30:11.322849  944109 main.go:141] libmachine: Using SSH client type: native
	I0717 20:30:11.323105  944109 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e2c70] 0x3e54d0 <nil>  [] 0s} 127.0.0.1 33834 <nil> <nil>}
	I0717 20:30:11.323124  944109 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sembed-certs-195036' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-195036/g' /etc/hosts;
				else 
					echo '127.0.1.1 embed-certs-195036' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0717 20:30:11.452188  944109 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0717 20:30:11.452217  944109 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19282-720845/.minikube CaCertPath:/home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19282-720845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19282-720845/.minikube}
	I0717 20:30:11.452243  944109 ubuntu.go:177] setting up certificates
	I0717 20:30:11.452254  944109 provision.go:84] configureAuth start
	I0717 20:30:11.452311  944109 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-195036
	I0717 20:30:11.468746  944109 provision.go:143] copyHostCerts
	I0717 20:30:11.468818  944109 exec_runner.go:144] found /home/jenkins/minikube-integration/19282-720845/.minikube/cert.pem, removing ...
	I0717 20:30:11.468832  944109 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19282-720845/.minikube/cert.pem
	I0717 20:30:11.468909  944109 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19282-720845/.minikube/cert.pem (1123 bytes)
	I0717 20:30:11.469019  944109 exec_runner.go:144] found /home/jenkins/minikube-integration/19282-720845/.minikube/key.pem, removing ...
	I0717 20:30:11.469030  944109 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19282-720845/.minikube/key.pem
	I0717 20:30:11.469063  944109 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19282-720845/.minikube/key.pem (1679 bytes)
	I0717 20:30:11.469130  944109 exec_runner.go:144] found /home/jenkins/minikube-integration/19282-720845/.minikube/ca.pem, removing ...
	I0717 20:30:11.469146  944109 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19282-720845/.minikube/ca.pem
	I0717 20:30:11.469174  944109 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19282-720845/.minikube/ca.pem (1078 bytes)
	I0717 20:30:11.469230  944109 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19282-720845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca-key.pem org=jenkins.embed-certs-195036 san=[127.0.0.1 192.168.85.2 embed-certs-195036 localhost minikube]
	I0717 20:30:08.719491  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:30:10.735195  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:30:12.436568  944109 provision.go:177] copyRemoteCerts
	I0717 20:30:12.436644  944109 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0717 20:30:12.436699  944109 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-195036
	I0717 20:30:12.458693  944109 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33834 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/embed-certs-195036/id_rsa Username:docker}
	I0717 20:30:12.553313  944109 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0717 20:30:12.580369  944109 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
	I0717 20:30:12.607623  944109 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0717 20:30:12.632690  944109 provision.go:87] duration metric: took 1.180421949s to configureAuth
	I0717 20:30:12.632734  944109 ubuntu.go:193] setting minikube options for container-runtime
	I0717 20:30:12.632920  944109 config.go:182] Loaded profile config "embed-certs-195036": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
	I0717 20:30:12.632935  944109 machine.go:97] duration metric: took 1.679683569s to provisionDockerMachine
	I0717 20:30:12.632943  944109 client.go:171] duration metric: took 10.107925526s to LocalClient.Create
	I0717 20:30:12.632964  944109 start.go:167] duration metric: took 10.108004827s to libmachine.API.Create "embed-certs-195036"
	I0717 20:30:12.632976  944109 start.go:293] postStartSetup for "embed-certs-195036" (driver="docker")
	I0717 20:30:12.632985  944109 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0717 20:30:12.633067  944109 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0717 20:30:12.633114  944109 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-195036
	I0717 20:30:12.651447  944109 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33834 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/embed-certs-195036/id_rsa Username:docker}
	I0717 20:30:12.741717  944109 ssh_runner.go:195] Run: cat /etc/os-release
	I0717 20:30:12.745114  944109 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0717 20:30:12.745154  944109 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0717 20:30:12.745167  944109 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0717 20:30:12.745175  944109 info.go:137] Remote host: Ubuntu 22.04.4 LTS
	I0717 20:30:12.745185  944109 filesync.go:126] Scanning /home/jenkins/minikube-integration/19282-720845/.minikube/addons for local assets ...
	I0717 20:30:12.745247  944109 filesync.go:126] Scanning /home/jenkins/minikube-integration/19282-720845/.minikube/files for local assets ...
	I0717 20:30:12.745330  944109 filesync.go:149] local asset: /home/jenkins/minikube-integration/19282-720845/.minikube/files/etc/ssl/certs/7262252.pem -> 7262252.pem in /etc/ssl/certs
	I0717 20:30:12.745439  944109 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0717 20:30:12.754826  944109 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/files/etc/ssl/certs/7262252.pem --> /etc/ssl/certs/7262252.pem (1708 bytes)
	I0717 20:30:12.781309  944109 start.go:296] duration metric: took 148.317426ms for postStartSetup
	I0717 20:30:12.781687  944109 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-195036
	I0717 20:30:12.798563  944109 profile.go:143] Saving config to /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/config.json ...
	I0717 20:30:12.798853  944109 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0717 20:30:12.798905  944109 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-195036
	I0717 20:30:12.816133  944109 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33834 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/embed-certs-195036/id_rsa Username:docker}
	I0717 20:30:12.905233  944109 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0717 20:30:12.909883  944109 start.go:128] duration metric: took 10.389635186s to createHost
	I0717 20:30:12.909923  944109 start.go:83] releasing machines lock for "embed-certs-195036", held for 10.38979739s
	I0717 20:30:12.910011  944109 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-195036
	I0717 20:30:12.926899  944109 ssh_runner.go:195] Run: cat /version.json
	I0717 20:30:12.926968  944109 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-195036
	I0717 20:30:12.926909  944109 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0717 20:30:12.927133  944109 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-195036
	I0717 20:30:12.954882  944109 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33834 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/embed-certs-195036/id_rsa Username:docker}
	I0717 20:30:12.964192  944109 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33834 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/embed-certs-195036/id_rsa Username:docker}
	I0717 20:30:13.180380  944109 ssh_runner.go:195] Run: systemctl --version
	I0717 20:30:13.185251  944109 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0717 20:30:13.189748  944109 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0717 20:30:13.215874  944109 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0717 20:30:13.215950  944109 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0717 20:30:13.247822  944109 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0717 20:30:13.247850  944109 start.go:495] detecting cgroup driver to use...
	I0717 20:30:13.247884  944109 detect.go:187] detected "cgroupfs" cgroup driver on host os
	I0717 20:30:13.247934  944109 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0717 20:30:13.261126  944109 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0717 20:30:13.273383  944109 docker.go:217] disabling cri-docker service (if available) ...
	I0717 20:30:13.273462  944109 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0717 20:30:13.288516  944109 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0717 20:30:13.304151  944109 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0717 20:30:13.407592  944109 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0717 20:30:13.508232  944109 docker.go:233] disabling docker service ...
	I0717 20:30:13.508305  944109 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0717 20:30:13.532015  944109 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0717 20:30:13.545721  944109 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0717 20:30:13.640821  944109 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0717 20:30:13.738355  944109 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0717 20:30:13.752670  944109 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0717 20:30:13.771808  944109 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I0717 20:30:13.782770  944109 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0717 20:30:13.794278  944109 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
	I0717 20:30:13.794373  944109 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0717 20:30:13.805625  944109 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0717 20:30:13.816834  944109 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0717 20:30:13.828908  944109 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0717 20:30:13.840221  944109 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0717 20:30:13.852126  944109 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0717 20:30:13.863254  944109 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
	I0717 20:30:13.873406  944109 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"
	I0717 20:30:13.885627  944109 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0717 20:30:13.894997  944109 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0717 20:30:13.904801  944109 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0717 20:30:14.007855  944109 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0717 20:30:14.174806  944109 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
	I0717 20:30:14.174877  944109 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0717 20:30:14.178919  944109 start.go:563] Will wait 60s for crictl version
	I0717 20:30:14.179033  944109 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.182871  944109 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0717 20:30:14.244419  944109 start.go:579] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.7.19
	RuntimeApiVersion:  v1
	I0717 20:30:14.244598  944109 ssh_runner.go:195] Run: containerd --version
	I0717 20:30:14.276114  944109 ssh_runner.go:195] Run: containerd --version
	I0717 20:30:14.324603  944109 out.go:177] * Preparing Kubernetes v1.30.2 on containerd 1.7.19 ...
	I0717 20:30:14.326822  944109 cli_runner.go:164] Run: docker network inspect embed-certs-195036 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0717 20:30:14.348252  944109 ssh_runner.go:195] Run: grep 192.168.85.1	host.minikube.internal$ /etc/hosts
	I0717 20:30:14.352451  944109 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0717 20:30:14.369851  944109 kubeadm.go:883] updating cluster {Name:embed-certs-195036 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:embed-certs-195036 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0717 20:30:14.369973  944109 preload.go:131] Checking if preload exists for k8s version v1.30.2 and runtime containerd
	I0717 20:30:14.370047  944109 ssh_runner.go:195] Run: sudo crictl images --output json
	I0717 20:30:14.414464  944109 containerd.go:627] all images are preloaded for containerd runtime.
	I0717 20:30:14.414486  944109 containerd.go:534] Images already preloaded, skipping extraction
	I0717 20:30:14.414546  944109 ssh_runner.go:195] Run: sudo crictl images --output json
	I0717 20:30:14.466960  944109 containerd.go:627] all images are preloaded for containerd runtime.
	I0717 20:30:14.467033  944109 cache_images.go:84] Images are preloaded, skipping loading
	I0717 20:30:14.467107  944109 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.30.2 containerd true true} ...
	I0717 20:30:14.467243  944109 kubeadm.go:946] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=embed-certs-195036 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.30.2 ClusterName:embed-certs-195036 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0717 20:30:14.467360  944109 ssh_runner.go:195] Run: sudo crictl info
	I0717 20:30:14.520577  944109 cni.go:84] Creating CNI manager for ""
	I0717 20:30:14.520601  944109 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 20:30:14.520612  944109 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0717 20:30:14.520635  944109 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.30.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-195036 NodeName:embed-certs-195036 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0717 20:30:14.520796  944109 kubeadm.go:187] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.85.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///run/containerd/containerd.sock
	  name: "embed-certs-195036"
	  kubeletExtraArgs:
	    node-ip: 192.168.85.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.30.2
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0717 20:30:14.520864  944109 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2
	I0717 20:30:14.535470  944109 binaries.go:44] Found k8s binaries, skipping transfer
	I0717 20:30:14.535593  944109 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0717 20:30:14.546236  944109 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (322 bytes)
	I0717 20:30:14.567648  944109 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0717 20:30:14.587806  944109 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2172 bytes)
	I0717 20:30:14.610963  944109 ssh_runner.go:195] Run: grep 192.168.85.2	control-plane.minikube.internal$ /etc/hosts
	I0717 20:30:14.615312  944109 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0717 20:30:14.629782  944109 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0717 20:30:14.746845  944109 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0717 20:30:14.765440  944109 certs.go:68] Setting up /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036 for IP: 192.168.85.2
	I0717 20:30:14.765463  944109 certs.go:194] generating shared ca certs ...
	I0717 20:30:14.765479  944109 certs.go:226] acquiring lock for ca certs: {Name:mk70fd46ee08fce14a9e7548fea7cc8fad7ae6a2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:30:14.765622  944109 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19282-720845/.minikube/ca.key
	I0717 20:30:14.765691  944109 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19282-720845/.minikube/proxy-client-ca.key
	I0717 20:30:14.765711  944109 certs.go:256] generating profile certs ...
	I0717 20:30:14.765778  944109 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/client.key
	I0717 20:30:14.765796  944109 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/client.crt with IP's: []
	I0717 20:30:15.177450  944109 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/client.crt ...
	I0717 20:30:15.177483  944109 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/client.crt: {Name:mk36526bc07c23bff0b4ba0f46ec81e730c96fe5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:30:15.177722  944109 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/client.key ...
	I0717 20:30:15.177739  944109 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/client.key: {Name:mkb03bc1dbaae543439b49d7d61a5c29e6fae779 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:30:15.178441  944109 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/apiserver.key.59c026f1
	I0717 20:30:15.178472  944109 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/apiserver.crt.59c026f1 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.85.2]
	I0717 20:30:16.447894  944109 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/apiserver.crt.59c026f1 ...
	I0717 20:30:16.447966  944109 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/apiserver.crt.59c026f1: {Name:mkba142375c3669b5e44cf5a4a3e7c0f294f706c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:30:16.448239  944109 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/apiserver.key.59c026f1 ...
	I0717 20:30:16.448282  944109 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/apiserver.key.59c026f1: {Name:mk1ad5161842aedf8b105010d74f2bc4f5d5a044 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:30:16.451581  944109 certs.go:381] copying /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/apiserver.crt.59c026f1 -> /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/apiserver.crt
	I0717 20:30:16.451769  944109 certs.go:385] copying /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/apiserver.key.59c026f1 -> /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/apiserver.key
	I0717 20:30:16.451928  944109 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/proxy-client.key
	I0717 20:30:16.451970  944109 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/proxy-client.crt with IP's: []
	I0717 20:30:16.863000  944109 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/proxy-client.crt ...
	I0717 20:30:16.863031  944109 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/proxy-client.crt: {Name:mkb14fb6500ee2b989200068c1b37beb96a4e274 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:30:16.863245  944109 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/proxy-client.key ...
	I0717 20:30:16.863261  944109 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/proxy-client.key: {Name:mked403344538e10d16a33c16c7107f6cf25ff72 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 20:30:16.863457  944109 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/726225.pem (1338 bytes)
	W0717 20:30:16.863501  944109 certs.go:480] ignoring /home/jenkins/minikube-integration/19282-720845/.minikube/certs/726225_empty.pem, impossibly tiny 0 bytes
	I0717 20:30:16.863515  944109 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca-key.pem (1675 bytes)
	I0717 20:30:16.863541  944109 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/ca.pem (1078 bytes)
	I0717 20:30:16.863576  944109 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/cert.pem (1123 bytes)
	I0717 20:30:16.863604  944109 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-720845/.minikube/certs/key.pem (1679 bytes)
	I0717 20:30:16.863656  944109 certs.go:484] found cert: /home/jenkins/minikube-integration/19282-720845/.minikube/files/etc/ssl/certs/7262252.pem (1708 bytes)
	I0717 20:30:16.864322  944109 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0717 20:30:16.891732  944109 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
	I0717 20:30:16.917650  944109 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0717 20:30:16.943208  944109 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0717 20:30:16.968837  944109 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
	I0717 20:30:16.994005  944109 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0717 20:30:17.022840  944109 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0717 20:30:17.049594  944109 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/embed-certs-195036/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0717 20:30:17.075769  944109 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0717 20:30:17.107793  944109 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/certs/726225.pem --> /usr/share/ca-certificates/726225.pem (1338 bytes)
	I0717 20:30:17.136324  944109 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19282-720845/.minikube/files/etc/ssl/certs/7262252.pem --> /usr/share/ca-certificates/7262252.pem (1708 bytes)
	I0717 20:30:17.166965  944109 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0717 20:30:13.221116  933934 pod_ready.go:102] pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace has status "Ready":"False"
	I0717 20:30:14.213455  933934 pod_ready.go:81] duration metric: took 4m0.000039803s for pod "metrics-server-9975d5f86-v4sfl" in "kube-system" namespace to be "Ready" ...
	E0717 20:30:14.213486  933934 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
	I0717 20:30:14.213497  933934 pod_ready.go:38] duration metric: took 5m27.099755562s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0717 20:30:14.213513  933934 api_server.go:52] waiting for apiserver process to appear ...
	I0717 20:30:14.213547  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0717 20:30:14.213608  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0717 20:30:14.267329  933934 cri.go:89] found id: "cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c"
	I0717 20:30:14.267350  933934 cri.go:89] found id: "f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc"
	I0717 20:30:14.267356  933934 cri.go:89] found id: ""
	I0717 20:30:14.267364  933934 logs.go:276] 2 containers: [cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc]
	I0717 20:30:14.267435  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.279495  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.283694  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0717 20:30:14.283767  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0717 20:30:14.332584  933934 cri.go:89] found id: "687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c"
	I0717 20:30:14.332625  933934 cri.go:89] found id: "e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1"
	I0717 20:30:14.332631  933934 cri.go:89] found id: ""
	I0717 20:30:14.332639  933934 logs.go:276] 2 containers: [687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1]
	I0717 20:30:14.332701  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.337032  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.341616  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0717 20:30:14.341702  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0717 20:30:14.416560  933934 cri.go:89] found id: "6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4"
	I0717 20:30:14.416585  933934 cri.go:89] found id: "03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294"
	I0717 20:30:14.416590  933934 cri.go:89] found id: ""
	I0717 20:30:14.416597  933934 logs.go:276] 2 containers: [6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4 03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294]
	I0717 20:30:14.416653  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.420874  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.426407  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0717 20:30:14.426493  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0717 20:30:14.474023  933934 cri.go:89] found id: "d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75"
	I0717 20:30:14.474043  933934 cri.go:89] found id: "bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef"
	I0717 20:30:14.474048  933934 cri.go:89] found id: ""
	I0717 20:30:14.474055  933934 logs.go:276] 2 containers: [d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75 bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef]
	I0717 20:30:14.474115  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.479393  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.483562  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0717 20:30:14.483645  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0717 20:30:14.546766  933934 cri.go:89] found id: "4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608"
	I0717 20:30:14.546789  933934 cri.go:89] found id: "3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4"
	I0717 20:30:14.546794  933934 cri.go:89] found id: ""
	I0717 20:30:14.546801  933934 logs.go:276] 2 containers: [4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608 3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4]
	I0717 20:30:14.546858  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.551041  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.555838  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0717 20:30:14.555914  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0717 20:30:14.607756  933934 cri.go:89] found id: "87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08"
	I0717 20:30:14.607786  933934 cri.go:89] found id: "fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f"
	I0717 20:30:14.607793  933934 cri.go:89] found id: ""
	I0717 20:30:14.607800  933934 logs.go:276] 2 containers: [87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08 fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f]
	I0717 20:30:14.607870  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.611951  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.615691  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I0717 20:30:14.615756  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0717 20:30:14.665764  933934 cri.go:89] found id: "1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874"
	I0717 20:30:14.665792  933934 cri.go:89] found id: "62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b"
	I0717 20:30:14.665797  933934 cri.go:89] found id: ""
	I0717 20:30:14.665805  933934 logs.go:276] 2 containers: [1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874 62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b]
	I0717 20:30:14.665859  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.672728  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.676956  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0717 20:30:14.677042  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0717 20:30:14.739516  933934 cri.go:89] found id: "57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0"
	I0717 20:30:14.739541  933934 cri.go:89] found id: "89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5"
	I0717 20:30:14.739562  933934 cri.go:89] found id: ""
	I0717 20:30:14.739570  933934 logs.go:276] 2 containers: [57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0 89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5]
	I0717 20:30:14.739628  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.743476  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.748788  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0717 20:30:14.748859  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0717 20:30:14.825367  933934 cri.go:89] found id: "44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1"
	I0717 20:30:14.825454  933934 cri.go:89] found id: ""
	I0717 20:30:14.825477  933934 logs.go:276] 1 containers: [44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1]
	I0717 20:30:14.825567  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:14.829469  933934 logs.go:123] Gathering logs for containerd ...
	I0717 20:30:14.829492  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0717 20:30:14.951471  933934 logs.go:123] Gathering logs for container status ...
	I0717 20:30:14.951551  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0717 20:30:15.002401  933934 logs.go:123] Gathering logs for describe nodes ...
	I0717 20:30:15.002553  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0717 20:30:15.257508  933934 logs.go:123] Gathering logs for kube-apiserver [f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc] ...
	I0717 20:30:15.257583  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc"
	I0717 20:30:15.326653  933934 logs.go:123] Gathering logs for etcd [687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c] ...
	I0717 20:30:15.326685  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c"
	I0717 20:30:15.396670  933934 logs.go:123] Gathering logs for etcd [e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1] ...
	I0717 20:30:15.396750  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1"
	I0717 20:30:15.473355  933934 logs.go:123] Gathering logs for kube-controller-manager [fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f] ...
	I0717 20:30:15.473711  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f"
	I0717 20:30:15.552525  933934 logs.go:123] Gathering logs for storage-provisioner [57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0] ...
	I0717 20:30:15.552603  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0"
	I0717 20:30:15.637695  933934 logs.go:123] Gathering logs for kindnet [62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b] ...
	I0717 20:30:15.637726  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b"
	I0717 20:30:15.746665  933934 logs.go:123] Gathering logs for kubelet ...
	I0717 20:30:15.746710  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0717 20:30:15.806130  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.042220     662 reflector.go:138] object-"kube-system"/"kube-proxy-token-7976r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-7976r" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.806356  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082566     662 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.806573  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082721     662 reflector.go:138] object-"kube-system"/"coredns-token-mrwzx": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-mrwzx" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.806781  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082802     662 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.807012  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082891     662 reflector.go:138] object-"kube-system"/"kindnet-token-g6tv7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-g6tv7" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.810861  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.202724     662 reflector.go:138] object-"kube-system"/"metrics-server-token-fksnv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-fksnv" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.811163  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.202810     662 reflector.go:138] object-"kube-system"/"storage-provisioner-token-rtf2k": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-rtf2k" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.811378  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.202881     662 reflector.go:138] object-"default"/"default-token-9ftpp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-9ftpp" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:15.819326  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:49 old-k8s-version-069806 kubelet[662]: E0717 20:24:49.183838     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:15.820329  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:50 old-k8s-version-069806 kubelet[662]: E0717 20:24:50.150410     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.823214  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:01 old-k8s-version-069806 kubelet[662]: E0717 20:25:01.900030     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:15.825532  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:11 old-k8s-version-069806 kubelet[662]: E0717 20:25:11.253734     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.825892  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:12 old-k8s-version-069806 kubelet[662]: E0717 20:25:12.256602     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.826084  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:12 old-k8s-version-069806 kubelet[662]: E0717 20:25:12.874626     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.826439  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:16 old-k8s-version-069806 kubelet[662]: E0717 20:25:16.266437     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.827342  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:20 old-k8s-version-069806 kubelet[662]: E0717 20:25:20.299236     662 pod_workers.go:191] Error syncing pod b733c4a6-f6de-426d-86c9-67948261d437 ("storage-provisioner_kube-system(b733c4a6-f6de-426d-86c9-67948261d437)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(b733c4a6-f6de-426d-86c9-67948261d437)"
	W0717 20:30:15.830056  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:27 old-k8s-version-069806 kubelet[662]: E0717 20:25:27.898396     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:15.831034  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:30 old-k8s-version-069806 kubelet[662]: E0717 20:25:30.313468     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.831554  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:36 old-k8s-version-069806 kubelet[662]: E0717 20:25:36.266512     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.831804  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:40 old-k8s-version-069806 kubelet[662]: E0717 20:25:40.874479     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.832142  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:51 old-k8s-version-069806 kubelet[662]: E0717 20:25:51.875881     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.832612  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:53 old-k8s-version-069806 kubelet[662]: E0717 20:25:53.400984     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.832942  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:56 old-k8s-version-069806 kubelet[662]: E0717 20:25:56.266353     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.833146  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:03 old-k8s-version-069806 kubelet[662]: E0717 20:26:03.874232     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.833523  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:09 old-k8s-version-069806 kubelet[662]: E0717 20:26:09.873806     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.836067  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:17 old-k8s-version-069806 kubelet[662]: E0717 20:26:17.885290     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:15.836428  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:21 old-k8s-version-069806 kubelet[662]: E0717 20:26:21.873819     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.836617  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:30 old-k8s-version-069806 kubelet[662]: E0717 20:26:30.874108     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.837267  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:37 old-k8s-version-069806 kubelet[662]: E0717 20:26:37.530420     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.837473  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:45 old-k8s-version-069806 kubelet[662]: E0717 20:26:45.874342     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.837808  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:46 old-k8s-version-069806 kubelet[662]: E0717 20:26:46.266436     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.838137  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:56 old-k8s-version-069806 kubelet[662]: E0717 20:26:56.873836     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.838324  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:00 old-k8s-version-069806 kubelet[662]: E0717 20:27:00.874137     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.838656  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:11 old-k8s-version-069806 kubelet[662]: E0717 20:27:11.873895     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.838842  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:13 old-k8s-version-069806 kubelet[662]: E0717 20:27:13.874116     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.839175  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:24 old-k8s-version-069806 kubelet[662]: E0717 20:27:24.873860     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.839382  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:28 old-k8s-version-069806 kubelet[662]: E0717 20:27:28.874119     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.839712  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:37 old-k8s-version-069806 kubelet[662]: E0717 20:27:37.874238     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.842301  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:41 old-k8s-version-069806 kubelet[662]: E0717 20:27:41.890695     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:15.842898  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:48 old-k8s-version-069806 kubelet[662]: E0717 20:27:48.873801     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.843101  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:56 old-k8s-version-069806 kubelet[662]: E0717 20:27:56.874330     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.843697  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:01 old-k8s-version-069806 kubelet[662]: E0717 20:28:01.743439     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.844026  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:06 old-k8s-version-069806 kubelet[662]: E0717 20:28:06.266883     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.844220  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:07 old-k8s-version-069806 kubelet[662]: E0717 20:28:07.874945     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.844574  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:19 old-k8s-version-069806 kubelet[662]: E0717 20:28:19.877659     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.844765  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:22 old-k8s-version-069806 kubelet[662]: E0717 20:28:22.874306     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.845161  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:33 old-k8s-version-069806 kubelet[662]: E0717 20:28:33.876747     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.845353  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:36 old-k8s-version-069806 kubelet[662]: E0717 20:28:36.874299     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.845696  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:46 old-k8s-version-069806 kubelet[662]: E0717 20:28:46.874249     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.845885  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:48 old-k8s-version-069806 kubelet[662]: E0717 20:28:48.874132     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.846215  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:58 old-k8s-version-069806 kubelet[662]: E0717 20:28:58.873786     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.846400  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:59 old-k8s-version-069806 kubelet[662]: E0717 20:28:59.874380     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.846728  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:11 old-k8s-version-069806 kubelet[662]: E0717 20:29:11.874254     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.846913  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:12 old-k8s-version-069806 kubelet[662]: E0717 20:29:12.874187     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.847274  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:26 old-k8s-version-069806 kubelet[662]: E0717 20:29:26.873840     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.847468  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:27 old-k8s-version-069806 kubelet[662]: E0717 20:29:27.875007     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.847853  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:38 old-k8s-version-069806 kubelet[662]: E0717 20:29:38.874336     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.848049  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:39 old-k8s-version-069806 kubelet[662]: E0717 20:29:39.874118     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.848393  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:49 old-k8s-version-069806 kubelet[662]: E0717 20:29:49.873788     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.848587  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:53 old-k8s-version-069806 kubelet[662]: E0717 20:29:53.876300     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.848920  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:02 old-k8s-version-069806 kubelet[662]: E0717 20:30:02.874275     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:15.849105  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:07 old-k8s-version-069806 kubelet[662]: E0717 20:30:07.874813     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:15.849436  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:14 old-k8s-version-069806 kubelet[662]: E0717 20:30:14.873785     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	I0717 20:30:15.849448  933934 logs.go:123] Gathering logs for coredns [6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4] ...
	I0717 20:30:15.849464  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4"
	I0717 20:30:15.925345  933934 logs.go:123] Gathering logs for kube-scheduler [d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75] ...
	I0717 20:30:15.925372  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75"
	I0717 20:30:15.979819  933934 logs.go:123] Gathering logs for kube-controller-manager [87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08] ...
	I0717 20:30:15.979850  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08"
	I0717 20:30:16.115833  933934 logs.go:123] Gathering logs for storage-provisioner [89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5] ...
	I0717 20:30:16.115883  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5"
	I0717 20:30:16.208534  933934 logs.go:123] Gathering logs for kubernetes-dashboard [44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1] ...
	I0717 20:30:16.208558  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1"
	I0717 20:30:16.281385  933934 logs.go:123] Gathering logs for kindnet [1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874] ...
	I0717 20:30:16.281410  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874"
	I0717 20:30:16.387166  933934 logs.go:123] Gathering logs for dmesg ...
	I0717 20:30:16.387204  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0717 20:30:16.451258  933934 logs.go:123] Gathering logs for kube-apiserver [cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c] ...
	I0717 20:30:16.451330  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c"
	I0717 20:30:16.530536  933934 logs.go:123] Gathering logs for coredns [03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294] ...
	I0717 20:30:16.530569  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294"
	I0717 20:30:16.587298  933934 logs.go:123] Gathering logs for kube-scheduler [bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef] ...
	I0717 20:30:16.587323  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef"
	I0717 20:30:16.653727  933934 logs.go:123] Gathering logs for kube-proxy [4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608] ...
	I0717 20:30:16.653809  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608"
	I0717 20:30:16.705193  933934 logs.go:123] Gathering logs for kube-proxy [3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4] ...
	I0717 20:30:16.705229  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4"
	I0717 20:30:16.766943  933934 out.go:304] Setting ErrFile to fd 2...
	I0717 20:30:16.766971  933934 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0717 20:30:16.767041  933934 out.go:239] X Problems detected in kubelet:
	W0717 20:30:16.767063  933934 out.go:239]   Jul 17 20:29:49 old-k8s-version-069806 kubelet[662]: E0717 20:29:49.873788     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:16.767086  933934 out.go:239]   Jul 17 20:29:53 old-k8s-version-069806 kubelet[662]: E0717 20:29:53.876300     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:16.767107  933934 out.go:239]   Jul 17 20:30:02 old-k8s-version-069806 kubelet[662]: E0717 20:30:02.874275     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:16.767119  933934 out.go:239]   Jul 17 20:30:07 old-k8s-version-069806 kubelet[662]: E0717 20:30:07.874813     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:16.767134  933934 out.go:239]   Jul 17 20:30:14 old-k8s-version-069806 kubelet[662]: E0717 20:30:14.873785     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	I0717 20:30:16.767141  933934 out.go:304] Setting ErrFile to fd 2...
	I0717 20:30:16.767155  933934 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 20:30:17.186462  944109 ssh_runner.go:195] Run: openssl version
	I0717 20:30:17.192214  944109 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0717 20:30:17.202157  944109 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0717 20:30:17.205887  944109 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul 17 19:36 /usr/share/ca-certificates/minikubeCA.pem
	I0717 20:30:17.206001  944109 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0717 20:30:17.212931  944109 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0717 20:30:17.222743  944109 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/726225.pem && ln -fs /usr/share/ca-certificates/726225.pem /etc/ssl/certs/726225.pem"
	I0717 20:30:17.232183  944109 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/726225.pem
	I0717 20:30:17.235652  944109 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul 17 19:43 /usr/share/ca-certificates/726225.pem
	I0717 20:30:17.235738  944109 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/726225.pem
	I0717 20:30:17.242673  944109 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/726225.pem /etc/ssl/certs/51391683.0"
	I0717 20:30:17.252550  944109 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7262252.pem && ln -fs /usr/share/ca-certificates/7262252.pem /etc/ssl/certs/7262252.pem"
	I0717 20:30:17.262172  944109 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7262252.pem
	I0717 20:30:17.265794  944109 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul 17 19:43 /usr/share/ca-certificates/7262252.pem
	I0717 20:30:17.265906  944109 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7262252.pem
	I0717 20:30:17.273181  944109 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/7262252.pem /etc/ssl/certs/3ec20f2e.0"
	I0717 20:30:17.282534  944109 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0717 20:30:17.285808  944109 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0717 20:30:17.285872  944109 kubeadm.go:392] StartCluster: {Name:embed-certs-195036 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:embed-certs-195036 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fal
se CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0717 20:30:17.285957  944109 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0717 20:30:17.286016  944109 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0717 20:30:17.324998  944109 cri.go:89] found id: ""
	I0717 20:30:17.325088  944109 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0717 20:30:17.334203  944109 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0717 20:30:17.342999  944109 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0717 20:30:17.343138  944109 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0717 20:30:17.359989  944109 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0717 20:30:17.360027  944109 kubeadm.go:157] found existing configuration files:
	
	I0717 20:30:17.360190  944109 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0717 20:30:17.373228  944109 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0717 20:30:17.373297  944109 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0717 20:30:17.383822  944109 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0717 20:30:17.394498  944109 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0717 20:30:17.394653  944109 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0717 20:30:17.405696  944109 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0717 20:30:17.415123  944109 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0717 20:30:17.415284  944109 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0717 20:30:17.424066  944109 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0717 20:30:17.433223  944109 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0717 20:30:17.433288  944109 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0717 20:30:17.443134  944109 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0717 20:30:17.493573  944109 kubeadm.go:310] [init] Using Kubernetes version: v1.30.2
	I0717 20:30:17.493992  944109 kubeadm.go:310] [preflight] Running pre-flight checks
	I0717 20:30:17.535820  944109 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
	I0717 20:30:17.535897  944109 kubeadm.go:310] KERNEL_VERSION: 5.15.0-1064-aws
	I0717 20:30:17.535937  944109 kubeadm.go:310] OS: Linux
	I0717 20:30:17.535986  944109 kubeadm.go:310] CGROUPS_CPU: enabled
	I0717 20:30:17.536035  944109 kubeadm.go:310] CGROUPS_CPUACCT: enabled
	I0717 20:30:17.536115  944109 kubeadm.go:310] CGROUPS_CPUSET: enabled
	I0717 20:30:17.536167  944109 kubeadm.go:310] CGROUPS_DEVICES: enabled
	I0717 20:30:17.536217  944109 kubeadm.go:310] CGROUPS_FREEZER: enabled
	I0717 20:30:17.536269  944109 kubeadm.go:310] CGROUPS_MEMORY: enabled
	I0717 20:30:17.536320  944109 kubeadm.go:310] CGROUPS_PIDS: enabled
	I0717 20:30:17.536370  944109 kubeadm.go:310] CGROUPS_HUGETLB: enabled
	I0717 20:30:17.536418  944109 kubeadm.go:310] CGROUPS_BLKIO: enabled
	I0717 20:30:17.607759  944109 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0717 20:30:17.607951  944109 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0717 20:30:17.608098  944109 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0717 20:30:17.851611  944109 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0717 20:30:17.855276  944109 out.go:204]   - Generating certificates and keys ...
	I0717 20:30:17.855480  944109 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0717 20:30:17.855603  944109 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0717 20:30:19.097702  944109 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0717 20:30:19.556647  944109 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
	I0717 20:30:19.938776  944109 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
	I0717 20:30:20.514473  944109 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
	I0717 20:30:21.220984  944109 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
	I0717 20:30:21.221396  944109 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [embed-certs-195036 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
	I0717 20:30:22.011336  944109 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
	I0717 20:30:22.011672  944109 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [embed-certs-195036 localhost] and IPs [192.168.85.2 127.0.0.1 ::1]
	I0717 20:30:22.388283  944109 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0717 20:30:22.933016  944109 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
	I0717 20:30:23.332722  944109 kubeadm.go:310] [certs] Generating "sa" key and public key
	I0717 20:30:23.332983  944109 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0717 20:30:23.685063  944109 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0717 20:30:24.029240  944109 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
	I0717 20:30:24.239143  944109 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0717 20:30:24.435933  944109 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0717 20:30:25.150976  944109 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0717 20:30:25.151593  944109 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0717 20:30:25.155145  944109 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0717 20:30:25.157443  944109 out.go:204]   - Booting up control plane ...
	I0717 20:30:25.157561  944109 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0717 20:30:25.158137  944109 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0717 20:30:25.159618  944109 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0717 20:30:25.176639  944109 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0717 20:30:25.178505  944109 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0717 20:30:25.178956  944109 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0717 20:30:25.282048  944109 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0717 20:30:25.282144  944109 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s
	I0717 20:30:26.283143  944109 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.00154778s
	I0717 20:30:26.283234  944109 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
	I0717 20:30:26.768428  933934 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0717 20:30:26.788723  933934 api_server.go:72] duration metric: took 5m56.839602005s to wait for apiserver process to appear ...
	I0717 20:30:26.788747  933934 api_server.go:88] waiting for apiserver healthz status ...
	I0717 20:30:26.788782  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-apiserver Namespaces:[]}
	I0717 20:30:26.788852  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
	I0717 20:30:26.854663  933934 cri.go:89] found id: "cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c"
	I0717 20:30:26.854684  933934 cri.go:89] found id: "f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc"
	I0717 20:30:26.854699  933934 cri.go:89] found id: ""
	I0717 20:30:26.854706  933934 logs.go:276] 2 containers: [cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc]
	I0717 20:30:26.854760  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:26.859009  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:26.866186  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:etcd Namespaces:[]}
	I0717 20:30:26.866263  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
	I0717 20:30:26.950492  933934 cri.go:89] found id: "687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c"
	I0717 20:30:26.950587  933934 cri.go:89] found id: "e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1"
	I0717 20:30:26.950628  933934 cri.go:89] found id: ""
	I0717 20:30:26.950673  933934 logs.go:276] 2 containers: [687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1]
	I0717 20:30:26.950792  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:26.957062  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:26.961377  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:coredns Namespaces:[]}
	I0717 20:30:26.961473  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
	I0717 20:30:27.059207  933934 cri.go:89] found id: "6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4"
	I0717 20:30:27.059234  933934 cri.go:89] found id: "03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294"
	I0717 20:30:27.059245  933934 cri.go:89] found id: ""
	I0717 20:30:27.059261  933934 logs.go:276] 2 containers: [6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4 03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294]
	I0717 20:30:27.059365  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.067097  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.075702  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-scheduler Namespaces:[]}
	I0717 20:30:27.075928  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
	I0717 20:30:27.167718  933934 cri.go:89] found id: "d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75"
	I0717 20:30:27.167820  933934 cri.go:89] found id: "bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef"
	I0717 20:30:27.167851  933934 cri.go:89] found id: ""
	I0717 20:30:27.167885  933934 logs.go:276] 2 containers: [d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75 bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef]
	I0717 20:30:27.168019  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.178946  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.187082  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-proxy Namespaces:[]}
	I0717 20:30:27.187280  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
	I0717 20:30:27.264168  933934 cri.go:89] found id: "4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608"
	I0717 20:30:27.264295  933934 cri.go:89] found id: "3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4"
	I0717 20:30:27.264323  933934 cri.go:89] found id: ""
	I0717 20:30:27.264369  933934 logs.go:276] 2 containers: [4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608 3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4]
	I0717 20:30:27.264494  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.271255  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.276920  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kube-controller-manager Namespaces:[]}
	I0717 20:30:27.277160  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
	I0717 20:30:27.352163  933934 cri.go:89] found id: "87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08"
	I0717 20:30:27.352255  933934 cri.go:89] found id: "fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f"
	I0717 20:30:27.352279  933934 cri.go:89] found id: ""
	I0717 20:30:27.352338  933934 logs.go:276] 2 containers: [87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08 fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f]
	I0717 20:30:27.352453  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.367677  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.371311  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kindnet Namespaces:[]}
	I0717 20:30:27.371398  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
	I0717 20:30:27.429211  933934 cri.go:89] found id: "1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874"
	I0717 20:30:27.429289  933934 cri.go:89] found id: "62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b"
	I0717 20:30:27.429313  933934 cri.go:89] found id: ""
	I0717 20:30:27.429367  933934 logs.go:276] 2 containers: [1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874 62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b]
	I0717 20:30:27.429472  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.436626  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.440515  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:storage-provisioner Namespaces:[]}
	I0717 20:30:27.440675  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=storage-provisioner
	I0717 20:30:27.514271  933934 cri.go:89] found id: "57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0"
	I0717 20:30:27.514316  933934 cri.go:89] found id: "89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5"
	I0717 20:30:27.514322  933934 cri.go:89] found id: ""
	I0717 20:30:27.514330  933934 logs.go:276] 2 containers: [57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0 89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5]
	I0717 20:30:27.514397  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.519671  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.525084  933934 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name:kubernetes-dashboard Namespaces:[]}
	I0717 20:30:27.525187  933934 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kubernetes-dashboard
	I0717 20:30:27.589900  933934 cri.go:89] found id: "44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1"
	I0717 20:30:27.589925  933934 cri.go:89] found id: ""
	I0717 20:30:27.589933  933934 logs.go:276] 1 containers: [44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1]
	I0717 20:30:27.589997  933934 ssh_runner.go:195] Run: which crictl
	I0717 20:30:27.596715  933934 logs.go:123] Gathering logs for describe nodes ...
	I0717 20:30:27.596747  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
	I0717 20:30:27.947618  933934 logs.go:123] Gathering logs for kube-scheduler [d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75] ...
	I0717 20:30:27.947656  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75"
	I0717 20:30:28.092581  933934 logs.go:123] Gathering logs for kube-proxy [3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4] ...
	I0717 20:30:28.092616  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4"
	I0717 20:30:28.170361  933934 logs.go:123] Gathering logs for storage-provisioner [89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5] ...
	I0717 20:30:28.170432  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5"
	I0717 20:30:28.276709  933934 logs.go:123] Gathering logs for kube-proxy [4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608] ...
	I0717 20:30:28.276780  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608"
	I0717 20:30:28.344367  933934 logs.go:123] Gathering logs for kube-controller-manager [fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f] ...
	I0717 20:30:28.344447  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f"
	I0717 20:30:28.451110  933934 logs.go:123] Gathering logs for kindnet [1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874] ...
	I0717 20:30:28.451194  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874"
	I0717 20:30:28.542709  933934 logs.go:123] Gathering logs for kindnet [62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b] ...
	I0717 20:30:28.542802  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b"
	I0717 20:30:28.629609  933934 logs.go:123] Gathering logs for kubelet ...
	I0717 20:30:28.629687  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
	W0717 20:30:28.722241  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.042220     662 reflector.go:138] object-"kube-system"/"kube-proxy-token-7976r": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kube-proxy-token-7976r" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.722576  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082566     662 reflector.go:138] object-"kube-system"/"coredns": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "coredns" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.722820  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082721     662 reflector.go:138] object-"kube-system"/"coredns-token-mrwzx": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "coredns-token-mrwzx" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.723070  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082802     662 reflector.go:138] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.723310  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.082891     662 reflector.go:138] object-"kube-system"/"kindnet-token-g6tv7": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "kindnet-token-g6tv7" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.727196  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.202724     662 reflector.go:138] object-"kube-system"/"metrics-server-token-fksnv": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "metrics-server-token-fksnv" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.730359  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.202810     662 reflector.go:138] object-"kube-system"/"storage-provisioner-token-rtf2k": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "storage-provisioner-token-rtf2k" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.730625  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:47 old-k8s-version-069806 kubelet[662]: E0717 20:24:47.202881     662 reflector.go:138] object-"default"/"default-token-9ftpp": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "default-token-9ftpp" is forbidden: User "system:node:old-k8s-version-069806" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'old-k8s-version-069806' and this object
	W0717 20:30:28.738782  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:49 old-k8s-version-069806 kubelet[662]: E0717 20:24:49.183838     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:28.745235  933934 logs.go:138] Found kubelet problem: Jul 17 20:24:50 old-k8s-version-069806 kubelet[662]: E0717 20:24:50.150410     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.748361  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:01 old-k8s-version-069806 kubelet[662]: E0717 20:25:01.900030     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:28.750574  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:11 old-k8s-version-069806 kubelet[662]: E0717 20:25:11.253734     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.755725  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:12 old-k8s-version-069806 kubelet[662]: E0717 20:25:12.256602     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.755972  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:12 old-k8s-version-069806 kubelet[662]: E0717 20:25:12.874626     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.756377  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:16 old-k8s-version-069806 kubelet[662]: E0717 20:25:16.266437     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.757278  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:20 old-k8s-version-069806 kubelet[662]: E0717 20:25:20.299236     662 pod_workers.go:191] Error syncing pod b733c4a6-f6de-426d-86c9-67948261d437 ("storage-provisioner_kube-system(b733c4a6-f6de-426d-86c9-67948261d437)"), skipping: failed to "StartContainer" for "storage-provisioner" with CrashLoopBackOff: "back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(b733c4a6-f6de-426d-86c9-67948261d437)"
	W0717 20:30:28.760001  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:27 old-k8s-version-069806 kubelet[662]: E0717 20:25:27.898396     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:28.761036  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:30 old-k8s-version-069806 kubelet[662]: E0717 20:25:30.313468     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.761536  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:36 old-k8s-version-069806 kubelet[662]: E0717 20:25:36.266512     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.761749  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:40 old-k8s-version-069806 kubelet[662]: E0717 20:25:40.874479     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.762116  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:51 old-k8s-version-069806 kubelet[662]: E0717 20:25:51.875881     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.762616  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:53 old-k8s-version-069806 kubelet[662]: E0717 20:25:53.400984     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.762983  933934 logs.go:138] Found kubelet problem: Jul 17 20:25:56 old-k8s-version-069806 kubelet[662]: E0717 20:25:56.266353     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.763201  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:03 old-k8s-version-069806 kubelet[662]: E0717 20:26:03.874232     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.763561  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:09 old-k8s-version-069806 kubelet[662]: E0717 20:26:09.873806     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.769545  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:17 old-k8s-version-069806 kubelet[662]: E0717 20:26:17.885290     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:28.769933  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:21 old-k8s-version-069806 kubelet[662]: E0717 20:26:21.873819     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.770148  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:30 old-k8s-version-069806 kubelet[662]: E0717 20:26:30.874108     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.770789  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:37 old-k8s-version-069806 kubelet[662]: E0717 20:26:37.530420     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.771010  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:45 old-k8s-version-069806 kubelet[662]: E0717 20:26:45.874342     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.771386  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:46 old-k8s-version-069806 kubelet[662]: E0717 20:26:46.266436     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.771754  933934 logs.go:138] Found kubelet problem: Jul 17 20:26:56 old-k8s-version-069806 kubelet[662]: E0717 20:26:56.873836     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.771969  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:00 old-k8s-version-069806 kubelet[662]: E0717 20:27:00.874137     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.772350  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:11 old-k8s-version-069806 kubelet[662]: E0717 20:27:11.873895     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.772565  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:13 old-k8s-version-069806 kubelet[662]: E0717 20:27:13.874116     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.772943  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:24 old-k8s-version-069806 kubelet[662]: E0717 20:27:24.873860     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.773157  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:28 old-k8s-version-069806 kubelet[662]: E0717 20:27:28.874119     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.773519  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:37 old-k8s-version-069806 kubelet[662]: E0717 20:27:37.874238     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.776173  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:41 old-k8s-version-069806 kubelet[662]: E0717 20:27:41.890695     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:28.776548  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:48 old-k8s-version-069806 kubelet[662]: E0717 20:27:48.873801     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.776763  933934 logs.go:138] Found kubelet problem: Jul 17 20:27:56 old-k8s-version-069806 kubelet[662]: E0717 20:27:56.874330     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.777477  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:01 old-k8s-version-069806 kubelet[662]: E0717 20:28:01.743439     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.777845  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:06 old-k8s-version-069806 kubelet[662]: E0717 20:28:06.266883     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.778060  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:07 old-k8s-version-069806 kubelet[662]: E0717 20:28:07.874945     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.778428  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:19 old-k8s-version-069806 kubelet[662]: E0717 20:28:19.877659     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.778647  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:22 old-k8s-version-069806 kubelet[662]: E0717 20:28:22.874306     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.779018  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:33 old-k8s-version-069806 kubelet[662]: E0717 20:28:33.876747     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.779245  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:36 old-k8s-version-069806 kubelet[662]: E0717 20:28:36.874299     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.779617  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:46 old-k8s-version-069806 kubelet[662]: E0717 20:28:46.874249     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.779835  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:48 old-k8s-version-069806 kubelet[662]: E0717 20:28:48.874132     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.780232  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:58 old-k8s-version-069806 kubelet[662]: E0717 20:28:58.873786     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.780448  933934 logs.go:138] Found kubelet problem: Jul 17 20:28:59 old-k8s-version-069806 kubelet[662]: E0717 20:28:59.874380     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.780808  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:11 old-k8s-version-069806 kubelet[662]: E0717 20:29:11.874254     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.781029  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:12 old-k8s-version-069806 kubelet[662]: E0717 20:29:12.874187     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.781398  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:26 old-k8s-version-069806 kubelet[662]: E0717 20:29:26.873840     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.781614  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:27 old-k8s-version-069806 kubelet[662]: E0717 20:29:27.875007     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.781979  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:38 old-k8s-version-069806 kubelet[662]: E0717 20:29:38.874336     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.782198  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:39 old-k8s-version-069806 kubelet[662]: E0717 20:29:39.874118     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.782564  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:49 old-k8s-version-069806 kubelet[662]: E0717 20:29:49.873788     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.782843  933934 logs.go:138] Found kubelet problem: Jul 17 20:29:53 old-k8s-version-069806 kubelet[662]: E0717 20:29:53.876300     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.783215  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:02 old-k8s-version-069806 kubelet[662]: E0717 20:30:02.874275     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.783432  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:07 old-k8s-version-069806 kubelet[662]: E0717 20:30:07.874813     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:28.783792  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:14 old-k8s-version-069806 kubelet[662]: E0717 20:30:14.873785     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:28.786430  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:22 old-k8s-version-069806 kubelet[662]: E0717 20:30:22.883566     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:28.786798  933934 logs.go:138] Found kubelet problem: Jul 17 20:30:25 old-k8s-version-069806 kubelet[662]: E0717 20:30:25.883025     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	I0717 20:30:28.786828  933934 logs.go:123] Gathering logs for coredns [6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4] ...
	I0717 20:30:28.786863  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4"
	I0717 20:30:28.833770  933934 logs.go:123] Gathering logs for coredns [03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294] ...
	I0717 20:30:28.833849  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294"
	I0717 20:30:28.895551  933934 logs.go:123] Gathering logs for kube-scheduler [bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef] ...
	I0717 20:30:28.895628  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef"
	I0717 20:30:28.995745  933934 logs.go:123] Gathering logs for containerd ...
	I0717 20:30:28.995823  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u containerd -n 400"
	I0717 20:30:29.100068  933934 logs.go:123] Gathering logs for dmesg ...
	I0717 20:30:29.100146  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
	I0717 20:30:29.125900  933934 logs.go:123] Gathering logs for kube-apiserver [cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c] ...
	I0717 20:30:29.126061  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c"
	I0717 20:30:29.268391  933934 logs.go:123] Gathering logs for etcd [e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1] ...
	I0717 20:30:29.268472  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1"
	I0717 20:30:29.345202  933934 logs.go:123] Gathering logs for kube-controller-manager [87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08] ...
	I0717 20:30:29.345282  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08"
	I0717 20:30:29.445718  933934 logs.go:123] Gathering logs for container status ...
	I0717 20:30:29.445797  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
	I0717 20:30:29.515085  933934 logs.go:123] Gathering logs for kube-apiserver [f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc] ...
	I0717 20:30:29.515163  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc"
	I0717 20:30:29.590224  933934 logs.go:123] Gathering logs for etcd [687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c] ...
	I0717 20:30:29.590313  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c"
	I0717 20:30:29.682136  933934 logs.go:123] Gathering logs for storage-provisioner [57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0] ...
	I0717 20:30:29.682207  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0"
	I0717 20:30:29.861255  933934 logs.go:123] Gathering logs for kubernetes-dashboard [44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1] ...
	I0717 20:30:29.861335  933934 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1"
	I0717 20:30:30.009936  933934 out.go:304] Setting ErrFile to fd 2...
	I0717 20:30:30.010027  933934 out.go:338] TERM=,COLORTERM=, which probably does not support color
	W0717 20:30:30.010116  933934 out.go:239] X Problems detected in kubelet:
	W0717 20:30:30.010456  933934 out.go:239]   Jul 17 20:30:02 old-k8s-version-069806 kubelet[662]: E0717 20:30:02.874275     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:30.010578  933934 out.go:239]   Jul 17 20:30:07 old-k8s-version-069806 kubelet[662]: E0717 20:30:07.874813     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	W0717 20:30:30.010645  933934 out.go:239]   Jul 17 20:30:14 old-k8s-version-069806 kubelet[662]: E0717 20:30:14.873785     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	W0717 20:30:30.010680  933934 out.go:239]   Jul 17 20:30:22 old-k8s-version-069806 kubelet[662]: E0717 20:30:22.883566     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	W0717 20:30:30.010757  933934 out.go:239]   Jul 17 20:30:25 old-k8s-version-069806 kubelet[662]: E0717 20:30:25.883025     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	I0717 20:30:30.010795  933934 out.go:304] Setting ErrFile to fd 2...
	I0717 20:30:30.010911  933934 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 20:30:34.785676  944109 kubeadm.go:310] [api-check] The API server is healthy after 8.50254231s
	I0717 20:30:34.805932  944109 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0717 20:30:34.821318  944109 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0717 20:30:34.846598  944109 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0717 20:30:34.846801  944109 kubeadm.go:310] [mark-control-plane] Marking the node embed-certs-195036 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0717 20:30:34.859418  944109 kubeadm.go:310] [bootstrap-token] Using token: 8ozjd6.lvmlncn5kssvgxzc
	I0717 20:30:34.861682  944109 out.go:204]   - Configuring RBAC rules ...
	I0717 20:30:34.861809  944109 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0717 20:30:34.867427  944109 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0717 20:30:34.875845  944109 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0717 20:30:34.879906  944109 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0717 20:30:34.886701  944109 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0717 20:30:34.890572  944109 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0717 20:30:35.193564  944109 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0717 20:30:35.631321  944109 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0717 20:30:36.194574  944109 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0717 20:30:36.195914  944109 kubeadm.go:310] 
	I0717 20:30:36.195993  944109 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0717 20:30:36.196005  944109 kubeadm.go:310] 
	I0717 20:30:36.196115  944109 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0717 20:30:36.196126  944109 kubeadm.go:310] 
	I0717 20:30:36.196150  944109 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0717 20:30:36.196211  944109 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0717 20:30:36.196260  944109 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0717 20:30:36.196265  944109 kubeadm.go:310] 
	I0717 20:30:36.196316  944109 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0717 20:30:36.196321  944109 kubeadm.go:310] 
	I0717 20:30:36.196367  944109 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0717 20:30:36.196371  944109 kubeadm.go:310] 
	I0717 20:30:36.196421  944109 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0717 20:30:36.196493  944109 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0717 20:30:36.196558  944109 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0717 20:30:36.196562  944109 kubeadm.go:310] 
	I0717 20:30:36.196643  944109 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0717 20:30:36.196716  944109 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0717 20:30:36.196725  944109 kubeadm.go:310] 
	I0717 20:30:36.196805  944109 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token 8ozjd6.lvmlncn5kssvgxzc \
	I0717 20:30:36.196905  944109 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:34e0ccb0f7b1bf9e782bfb56d5c2100b0d5ea9242ea9a17a9e471a56e94c8d3a \
	I0717 20:30:36.196924  944109 kubeadm.go:310] 	--control-plane 
	I0717 20:30:36.196933  944109 kubeadm.go:310] 
	I0717 20:30:36.197014  944109 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0717 20:30:36.197019  944109 kubeadm.go:310] 
	I0717 20:30:36.197097  944109 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token 8ozjd6.lvmlncn5kssvgxzc \
	I0717 20:30:36.197195  944109 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:34e0ccb0f7b1bf9e782bfb56d5c2100b0d5ea9242ea9a17a9e471a56e94c8d3a 
	I0717 20:30:36.201985  944109 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1064-aws\n", err: exit status 1
	I0717 20:30:36.202102  944109 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0717 20:30:36.202122  944109 cni.go:84] Creating CNI manager for ""
	I0717 20:30:36.202130  944109 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 20:30:36.204460  944109 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0717 20:30:36.206408  944109 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0717 20:30:36.210930  944109 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.2/kubectl ...
	I0717 20:30:36.210951  944109 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0717 20:30:36.231518  944109 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0717 20:30:36.537367  944109 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0717 20:30:36.537513  944109 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:30:36.537612  944109 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes embed-certs-195036 minikube.k8s.io/updated_at=2024_07_17T20_30_36_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=ea5c2d8818055de88db951b296600d4e926998e6 minikube.k8s.io/name=embed-certs-195036 minikube.k8s.io/primary=true
	I0717 20:30:36.750086  944109 ops.go:34] apiserver oom_adj: -16
	I0717 20:30:36.750200  944109 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 20:30:40.013310  933934 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0717 20:30:40.037373  933934 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0717 20:30:40.040368  933934 out.go:177] 
	W0717 20:30:40.043794  933934 out.go:239] X Exiting due to K8S_UNHEALTHY_CONTROL_PLANE: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.20.0
	W0717 20:30:40.043842  933934 out.go:239] * Suggestion: Control Plane could not update, try minikube delete --all --purge
	W0717 20:30:40.043863  933934 out.go:239] * Related issue: https://github.com/kubernetes/minikube/issues/11417
	W0717 20:30:40.043869  933934 out.go:239] * 
	W0717 20:30:40.044970  933934 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0717 20:30:40.055997  933934 out.go:177] 
	
	
	==> container status <==
	CONTAINER           IMAGE               CREATED             STATE               NAME                        ATTEMPT             POD ID              POD
	3ca5b52c96d52       523cad1a4df73       2 minutes ago       Exited              dashboard-metrics-scraper   5                   96a9dfce9cc27       dashboard-metrics-scraper-8d5bb5db8-pmx8k
	57b729d79f17d       ba04bb24b9575       5 minutes ago       Running             storage-provisioner         3                   513c5ae77c72d       storage-provisioner
	44895de258222       20b332c9a70d8       5 minutes ago       Running             kubernetes-dashboard        0                   9a0159cfa45e6       kubernetes-dashboard-cd95d586-bllqh
	6dc999a35d5b7       db91994f4ee8f       5 minutes ago       Running             coredns                     1                   97af6107c1659       coredns-74ff55c5b-9djzb
	4157f24e3104c       25a5233254979       5 minutes ago       Running             kube-proxy                  1                   aa53d0fbf792e       kube-proxy-gh8ms
	1f4da85e26923       5e32961ddcea3       5 minutes ago       Running             kindnet-cni                 1                   c7d05390e7b01       kindnet-mv7j6
	89d02f9d8a4af       ba04bb24b9575       5 minutes ago       Exited              storage-provisioner         2                   513c5ae77c72d       storage-provisioner
	6e6804e5bfb2a       1611cd07b61d5       5 minutes ago       Running             busybox                     1                   3abb1c3edbfdb       busybox
	d6de24a696fe6       e7605f88f17d6       6 minutes ago       Running             kube-scheduler              1                   921a8e28d120d       kube-scheduler-old-k8s-version-069806
	cd37e487a6296       2c08bbbc02d3a       6 minutes ago       Running             kube-apiserver              1                   e5b3f9d873ac4       kube-apiserver-old-k8s-version-069806
	87f12b148cc5c       1df8a2b116bd1       6 minutes ago       Running             kube-controller-manager     1                   9632a066efe2f       kube-controller-manager-old-k8s-version-069806
	687abee290206       05b738aa1bc63       6 minutes ago       Running             etcd                        1                   88d25167c7ef6       etcd-old-k8s-version-069806
	710cfa588d31c       1611cd07b61d5       6 minutes ago       Exited              busybox                     0                   0b70057e83b3f       busybox
	03f122fd4abc9       db91994f4ee8f       8 minutes ago       Exited              coredns                     0                   7d9f906126a09       coredns-74ff55c5b-9djzb
	62bdf5d2d244d       5e32961ddcea3       8 minutes ago       Exited              kindnet-cni                 0                   a941725ff33f2       kindnet-mv7j6
	3a29c0026d940       25a5233254979       8 minutes ago       Exited              kube-proxy                  0                   c290d849c1f38       kube-proxy-gh8ms
	bcdcb609ea0d9       e7605f88f17d6       9 minutes ago       Exited              kube-scheduler              0                   4ecc926200169       kube-scheduler-old-k8s-version-069806
	fdcb50d15d027       1df8a2b116bd1       9 minutes ago       Exited              kube-controller-manager     0                   87cadf2efa3e4       kube-controller-manager-old-k8s-version-069806
	e570d714588a4       05b738aa1bc63       9 minutes ago       Exited              etcd                        0                   a510894671347       etcd-old-k8s-version-069806
	f910fbeca2eeb       2c08bbbc02d3a       9 minutes ago       Exited              kube-apiserver              0                   340e3a2621932       kube-apiserver-old-k8s-version-069806
	
	
	==> containerd <==
	Jul 17 20:26:36 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:26:36.901707256Z" level=info msg="CreateContainer within sandbox \"96a9dfce9cc278e4f991664520cbcf41632392376e90ddec55990c1d6239ef5a\" for name:\"dashboard-metrics-scraper\" attempt:4 returns container id \"36655d74bd12cc0972863cc002143c167af24a2e5eb25095a3087e9747f3c042\""
	Jul 17 20:26:36 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:26:36.902459747Z" level=info msg="StartContainer for \"36655d74bd12cc0972863cc002143c167af24a2e5eb25095a3087e9747f3c042\""
	Jul 17 20:26:36 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:26:36.978064180Z" level=info msg="StartContainer for \"36655d74bd12cc0972863cc002143c167af24a2e5eb25095a3087e9747f3c042\" returns successfully"
	Jul 17 20:26:37 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:26:37.022249035Z" level=info msg="shim disconnected" id=36655d74bd12cc0972863cc002143c167af24a2e5eb25095a3087e9747f3c042 namespace=k8s.io
	Jul 17 20:26:37 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:26:37.022691404Z" level=warning msg="cleaning up after shim disconnected" id=36655d74bd12cc0972863cc002143c167af24a2e5eb25095a3087e9747f3c042 namespace=k8s.io
	Jul 17 20:26:37 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:26:37.022920519Z" level=info msg="cleaning up dead shim" namespace=k8s.io
	Jul 17 20:26:37 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:26:37.531495692Z" level=info msg="RemoveContainer for \"ab72fba8faa2c5f620b18e18a28109d77256c56d9f62ca303fd730fdce33c6c4\""
	Jul 17 20:26:37 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:26:37.538765998Z" level=info msg="RemoveContainer for \"ab72fba8faa2c5f620b18e18a28109d77256c56d9f62ca303fd730fdce33c6c4\" returns successfully"
	Jul 17 20:27:41 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:27:41.874864103Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 17 20:27:41 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:27:41.887384762Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
	Jul 17 20:27:41 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:27:41.889328633Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	Jul 17 20:27:41 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:27:41.889411043Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
	Jul 17 20:28:00 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:28:00.875621820Z" level=info msg="CreateContainer within sandbox \"96a9dfce9cc278e4f991664520cbcf41632392376e90ddec55990c1d6239ef5a\" for container name:\"dashboard-metrics-scraper\" attempt:5"
	Jul 17 20:28:00 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:28:00.890865318Z" level=info msg="CreateContainer within sandbox \"96a9dfce9cc278e4f991664520cbcf41632392376e90ddec55990c1d6239ef5a\" for name:\"dashboard-metrics-scraper\" attempt:5 returns container id \"3ca5b52c96d52265da32472b962c89e0ca2efe33f6b1148f0a6a9cb84fcd1004\""
	Jul 17 20:28:00 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:28:00.891461185Z" level=info msg="StartContainer for \"3ca5b52c96d52265da32472b962c89e0ca2efe33f6b1148f0a6a9cb84fcd1004\""
	Jul 17 20:28:00 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:28:00.968680507Z" level=info msg="StartContainer for \"3ca5b52c96d52265da32472b962c89e0ca2efe33f6b1148f0a6a9cb84fcd1004\" returns successfully"
	Jul 17 20:28:00 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:28:00.993245012Z" level=info msg="shim disconnected" id=3ca5b52c96d52265da32472b962c89e0ca2efe33f6b1148f0a6a9cb84fcd1004 namespace=k8s.io
	Jul 17 20:28:00 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:28:00.993320940Z" level=warning msg="cleaning up after shim disconnected" id=3ca5b52c96d52265da32472b962c89e0ca2efe33f6b1148f0a6a9cb84fcd1004 namespace=k8s.io
	Jul 17 20:28:00 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:28:00.993341502Z" level=info msg="cleaning up dead shim" namespace=k8s.io
	Jul 17 20:28:01 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:28:01.748386202Z" level=info msg="RemoveContainer for \"36655d74bd12cc0972863cc002143c167af24a2e5eb25095a3087e9747f3c042\""
	Jul 17 20:28:01 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:28:01.755886182Z" level=info msg="RemoveContainer for \"36655d74bd12cc0972863cc002143c167af24a2e5eb25095a3087e9747f3c042\" returns successfully"
	Jul 17 20:30:22 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:30:22.875674825Z" level=info msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 17 20:30:22 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:30:22.880862805Z" level=info msg="trying next host" error="failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host" host=fake.domain
	Jul 17 20:30:22 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:30:22.882276146Z" level=error msg="PullImage \"fake.domain/registry.k8s.io/echoserver:1.4\" failed" error="failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	Jul 17 20:30:22 old-k8s-version-069806 containerd[571]: time="2024-07-17T20:30:22.882359943Z" level=info msg="stop pulling image fake.domain/registry.k8s.io/echoserver:1.4: active requests=0, bytes read=0"
	
	
	==> coredns [03f122fd4abc96b4162eaa9b0110afa04333b847fc74cafe0a68ca5d30990294] <==
	.:53
	[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
	CoreDNS-1.7.0
	linux/arm64, go1.14.4, f59c03d
	[INFO] 127.0.0.1:49567 - 9284 "HINFO IN 8087561133339694968.926235833535079580. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.024484485s
	
	
	==> coredns [6dc999a35d5b7cabe60ac89e4d0eeda4c16d4bdf70c86b94f130a692166a53d4] <==
	.:53
	[INFO] plugin/reload: Running configuration MD5 = b494d968e357ba1b925cee838fbd78ed
	CoreDNS-1.7.0
	linux/arm64, go1.14.4, f59c03d
	[INFO] 127.0.0.1:50910 - 39021 "HINFO IN 3340031814968280805.4266197550235982388. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.022556982s
	
	
	==> describe nodes <==
	Name:               old-k8s-version-069806
	Roles:              control-plane,master
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=old-k8s-version-069806
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=ea5c2d8818055de88db951b296600d4e926998e6
	                    minikube.k8s.io/name=old-k8s-version-069806
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_07_17T20_21_48_0700
	                    minikube.k8s.io/version=v1.33.1
	                    node-role.kubernetes.io/control-plane=
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Wed, 17 Jul 2024 20:21:44 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  old-k8s-version-069806
	  AcquireTime:     <unset>
	  RenewTime:       Wed, 17 Jul 2024 20:30:39 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Wed, 17 Jul 2024 20:25:47 +0000   Wed, 17 Jul 2024 20:21:38 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Wed, 17 Jul 2024 20:25:47 +0000   Wed, 17 Jul 2024 20:21:38 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Wed, 17 Jul 2024 20:25:47 +0000   Wed, 17 Jul 2024 20:21:38 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Wed, 17 Jul 2024 20:25:47 +0000   Wed, 17 Jul 2024 20:22:03 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.76.2
	  Hostname:    old-k8s-version-069806
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022360Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022360Ki
	  pods:               110
	System Info:
	  Machine ID:                 f40817a4f4664320be724278d57ca186
	  System UUID:                efd66201-957c-4716-b850-0ae965fa2ba0
	  Boot ID:                    d15a549a-b231-4e52-8730-2a5b60959e25
	  Kernel Version:             5.15.0-1064-aws
	  OS Image:                   Ubuntu 22.04.4 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  containerd://1.7.19
	  Kubelet Version:            v1.20.0
	  Kube-Proxy Version:         v1.20.0
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (12 in total)
	  Namespace                   Name                                              CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                   ----                                              ------------  ----------  ---------------  -------------  ---
	  default                     busybox                                           0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m43s
	  kube-system                 coredns-74ff55c5b-9djzb                           100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     8m38s
	  kube-system                 etcd-old-k8s-version-069806                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         8m45s
	  kube-system                 kindnet-mv7j6                                     100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      8m38s
	  kube-system                 kube-apiserver-old-k8s-version-069806             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m45s
	  kube-system                 kube-controller-manager-old-k8s-version-069806    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m45s
	  kube-system                 kube-proxy-gh8ms                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m38s
	  kube-system                 kube-scheduler-old-k8s-version-069806             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m45s
	  kube-system                 metrics-server-9975d5f86-v4sfl                    100m (5%!)(MISSING)     0 (0%!)(MISSING)      200Mi (2%!)(MISSING)       0 (0%!)(MISSING)         6m31s
	  kube-system                 storage-provisioner                               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m37s
	  kubernetes-dashboard        dashboard-metrics-scraper-8d5bb5db8-pmx8k         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m37s
	  kubernetes-dashboard        kubernetes-dashboard-cd95d586-bllqh               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m37s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (47%!)(MISSING)  100m (5%!)(MISSING)
	  memory             420Mi (5%!)(MISSING)  220Mi (2%!)(MISSING)
	  ephemeral-storage  100Mi (0%!)(MISSING)  0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                  From        Message
	  ----    ------                   ----                 ----        -------
	  Normal  NodeHasSufficientMemory  9m5s (x4 over 9m5s)  kubelet     Node old-k8s-version-069806 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    9m5s (x4 over 9m5s)  kubelet     Node old-k8s-version-069806 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     9m5s (x5 over 9m5s)  kubelet     Node old-k8s-version-069806 status is now: NodeHasSufficientPID
	  Normal  Starting                 8m46s                kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  8m46s                kubelet     Node old-k8s-version-069806 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    8m46s                kubelet     Node old-k8s-version-069806 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     8m46s                kubelet     Node old-k8s-version-069806 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  8m45s                kubelet     Updated Node Allocatable limit across pods
	  Normal  NodeReady                8m38s                kubelet     Node old-k8s-version-069806 status is now: NodeReady
	  Normal  Starting                 8m36s                kube-proxy  Starting kube-proxy.
	  Normal  Starting                 6m4s                 kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  6m4s (x8 over 6m4s)  kubelet     Node old-k8s-version-069806 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    6m4s (x8 over 6m4s)  kubelet     Node old-k8s-version-069806 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     6m4s (x7 over 6m4s)  kubelet     Node old-k8s-version-069806 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  6m4s                 kubelet     Updated Node Allocatable limit across pods
	  Normal  Starting                 5m51s                kube-proxy  Starting kube-proxy.
	
	
	==> dmesg <==
	[  +0.001047] FS-Cache: O-key=[8] '0c71ed0000000000'
	[  +0.000704] FS-Cache: N-cookie c=00000030 [p=00000027 fl=2 nc=0 na=1]
	[  +0.000948] FS-Cache: N-cookie d=0000000057175b43{9p.inode} n=0000000006a19ff2
	[  +0.001050] FS-Cache: N-key=[8] '0c71ed0000000000'
	[  +0.003590] FS-Cache: Duplicate cookie detected
	[  +0.000766] FS-Cache: O-cookie c=0000002a [p=00000027 fl=226 nc=0 na=1]
	[  +0.000975] FS-Cache: O-cookie d=0000000057175b43{9p.inode} n=0000000064350dd4
	[  +0.001051] FS-Cache: O-key=[8] '0c71ed0000000000'
	[  +0.000709] FS-Cache: N-cookie c=00000031 [p=00000027 fl=2 nc=0 na=1]
	[  +0.000957] FS-Cache: N-cookie d=0000000057175b43{9p.inode} n=00000000e3dc1602
	[  +0.001084] FS-Cache: N-key=[8] '0c71ed0000000000'
	[  +2.766171] FS-Cache: Duplicate cookie detected
	[  +0.000781] FS-Cache: O-cookie c=00000028 [p=00000027 fl=226 nc=0 na=1]
	[  +0.001056] FS-Cache: O-cookie d=0000000057175b43{9p.inode} n=000000002c3db926
	[  +0.001078] FS-Cache: O-key=[8] '0b71ed0000000000'
	[  +0.000725] FS-Cache: N-cookie c=00000033 [p=00000027 fl=2 nc=0 na=1]
	[  +0.000971] FS-Cache: N-cookie d=0000000057175b43{9p.inode} n=0000000028100d9c
	[  +0.001082] FS-Cache: N-key=[8] '0b71ed0000000000'
	[  +0.321844] FS-Cache: Duplicate cookie detected
	[  +0.000709] FS-Cache: O-cookie c=0000002d [p=00000027 fl=226 nc=0 na=1]
	[  +0.001033] FS-Cache: O-cookie d=0000000057175b43{9p.inode} n=0000000002b9fe32
	[  +0.001056] FS-Cache: O-key=[8] '1171ed0000000000'
	[  +0.000710] FS-Cache: N-cookie c=00000034 [p=00000027 fl=2 nc=0 na=1]
	[  +0.000964] FS-Cache: N-cookie d=0000000057175b43{9p.inode} n=0000000006a19ff2
	[  +0.001068] FS-Cache: N-key=[8] '1171ed0000000000'
	
	
	==> etcd [687abee290206c4efc81f20fc7a1ed7bbd6be9374ad6bbb86d674109b406be0c] <==
	2024-07-17 20:26:41.877710 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:26:51.876672 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:27:01.876657 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:27:11.875467 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:27:21.874639 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:27:31.876505 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:27:41.877731 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:27:51.874629 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:28:01.876146 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:28:11.878016 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:28:21.874560 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:28:31.879430 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:28:41.876424 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:28:51.877999 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:29:01.875020 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:29:11.875311 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:29:21.874586 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:29:31.875167 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:29:41.878031 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:29:51.874641 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:30:01.874733 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:30:11.878288 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:30:21.888776 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:30:31.874438 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:30:41.874401 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	
	
	==> etcd [e570d714588a47af78dc81d95545a2a3f0ac0ae3acb938112dc2a7230b0a49b1] <==
	raft2024/07/17 20:21:37 INFO: ea7e25599daad906 became leader at term 2
	raft2024/07/17 20:21:37 INFO: raft.node: ea7e25599daad906 elected leader ea7e25599daad906 at term 2
	2024-07-17 20:21:37.804704 I | etcdserver: published {Name:old-k8s-version-069806 ClientURLs:[https://192.168.76.2:2379]} to cluster 6f20f2c4b2fb5f8a
	2024-07-17 20:21:37.804865 I | embed: ready to serve client requests
	2024-07-17 20:21:37.811873 I | etcdserver: setting up the initial cluster version to 3.4
	2024-07-17 20:21:37.821401 I | embed: serving client requests on 127.0.0.1:2379
	2024-07-17 20:21:37.824138 I | embed: ready to serve client requests
	2024-07-17 20:21:37.825653 I | embed: serving client requests on 192.168.76.2:2379
	2024-07-17 20:21:37.852061 N | etcdserver/membership: set the initial cluster version to 3.4
	2024-07-17 20:21:37.852387 I | etcdserver/api: enabled capabilities for version 3.4
	2024-07-17 20:21:47.326248 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:21:57.090107 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:22:05.494082 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:22:15.490094 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:22:25.489999 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:22:35.490010 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:22:45.490043 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:22:55.490090 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:23:05.490129 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:23:15.489951 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:23:25.490154 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:23:35.489914 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:23:45.490040 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:23:55.489988 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	2024-07-17 20:24:05.490040 I | etcdserver/api/etcdhttp: /health OK (status code 200)
	
	
	==> kernel <==
	 20:30:42 up  4:13,  0 users,  load average: 2.30, 2.10, 2.60
	Linux old-k8s-version-069806 5.15.0-1064-aws #70~20.04.1-Ubuntu SMP Thu Jun 27 14:52:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.4 LTS"
	
	
	==> kindnet [1f4da85e269235a6b1b8eba0cc55aa66708531b2d77a77c6fd4c1b3d649ff874] <==
	E0717 20:29:25.866179       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	I0717 20:29:30.728977       1 main.go:299] Handling node with IPs: map[192.168.76.2:{}]
	I0717 20:29:30.729025       1 main.go:303] handling current node
	W0717 20:29:33.832009       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0717 20:29:33.832085       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0717 20:29:40.729506       1 main.go:299] Handling node with IPs: map[192.168.76.2:{}]
	I0717 20:29:40.729711       1 main.go:303] handling current node
	I0717 20:29:50.729352       1 main.go:299] Handling node with IPs: map[192.168.76.2:{}]
	I0717 20:29:50.729394       1 main.go:303] handling current node
	I0717 20:30:00.729073       1 main.go:299] Handling node with IPs: map[192.168.76.2:{}]
	I0717 20:30:00.729130       1 main.go:303] handling current node
	W0717 20:30:09.957298       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0717 20:30:09.957530       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0717 20:30:10.731496       1 main.go:299] Handling node with IPs: map[192.168.76.2:{}]
	I0717 20:30:10.731538       1 main.go:303] handling current node
	W0717 20:30:11.003551       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0717 20:30:11.003608       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	I0717 20:30:20.729001       1 main.go:299] Handling node with IPs: map[192.168.76.2:{}]
	I0717 20:30:20.729175       1 main.go:303] handling current node
	W0717 20:30:21.632928       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0717 20:30:21.632969       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	I0717 20:30:30.728862       1 main.go:299] Handling node with IPs: map[192.168.76.2:{}]
	I0717 20:30:30.728905       1 main.go:303] handling current node
	I0717 20:30:40.729361       1 main.go:299] Handling node with IPs: map[192.168.76.2:{}]
	I0717 20:30:40.729393       1 main.go:303] handling current node
	
	
	==> kindnet [62bdf5d2d244d2f8c5398ebc927cf85a2d9e82aa5dae832ea5ce7dd7bf6e863b] <==
	I0717 20:23:07.534044       1 main.go:303] handling current node
	W0717 20:23:09.545572       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0717 20:23:09.545610       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	I0717 20:23:17.533866       1 main.go:299] Handling node with IPs: map[192.168.76.2:{}]
	I0717 20:23:17.533901       1 main.go:303] handling current node
	W0717 20:23:19.477434       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0717 20:23:19.477469       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	W0717 20:23:23.680253       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0717 20:23:23.680290       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0717 20:23:27.533116       1 main.go:299] Handling node with IPs: map[192.168.76.2:{}]
	I0717 20:23:27.533160       1 main.go:303] handling current node
	I0717 20:23:37.533188       1 main.go:299] Handling node with IPs: map[192.168.76.2:{}]
	I0717 20:23:37.533224       1 main.go:303] handling current node
	W0717 20:23:44.435313       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	E0717 20:23:44.435350       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "pods" in API group "" at the cluster scope
	I0717 20:23:47.533359       1 main.go:299] Handling node with IPs: map[192.168.76.2:{}]
	I0717 20:23:47.533399       1 main.go:303] handling current node
	W0717 20:23:56.746874       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	E0717 20:23:56.747929       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "namespaces" in API group "" at the cluster scope
	I0717 20:23:57.533189       1 main.go:299] Handling node with IPs: map[192.168.76.2:{}]
	I0717 20:23:57.533411       1 main.go:303] handling current node
	W0717 20:24:04.570249       1 reflector.go:547] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	E0717 20:24:04.570289       1 reflector.go:150] pkg/mod/k8s.io/client-go@v0.30.2/tools/cache/reflector.go:232: Failed to watch *v1.NetworkPolicy: failed to list *v1.NetworkPolicy: networkpolicies.networking.k8s.io is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "networkpolicies" in API group "networking.k8s.io" at the cluster scope
	I0717 20:24:07.533884       1 main.go:299] Handling node with IPs: map[192.168.76.2:{}]
	I0717 20:24:07.534116       1 main.go:303] handling current node
	
	
	==> kube-apiserver [cd37e487a62960309ed82922e0a8a525350123f65c49e5f04cfa975054d7d21c] <==
	I0717 20:27:16.168128       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0717 20:27:16.168137       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0717 20:27:47.731993       1 client.go:360] parsed scheme: "passthrough"
	I0717 20:27:47.732077       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0717 20:27:47.732087       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	W0717 20:27:50.138363       1 handler_proxy.go:102] no RequestInfo found in the context
	E0717 20:27:50.138443       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0717 20:27:50.138452       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0717 20:28:30.577033       1 client.go:360] parsed scheme: "passthrough"
	I0717 20:28:30.577147       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0717 20:28:30.577181       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0717 20:29:05.917192       1 client.go:360] parsed scheme: "passthrough"
	I0717 20:29:05.917246       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0717 20:29:05.917255       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0717 20:29:41.464747       1 client.go:360] parsed scheme: "passthrough"
	I0717 20:29:41.464847       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0717 20:29:41.464858       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	W0717 20:29:48.222695       1 handler_proxy.go:102] no RequestInfo found in the context
	E0717 20:29:48.222767       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0717 20:29:48.222777       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0717 20:30:23.483727       1 client.go:360] parsed scheme: "passthrough"
	I0717 20:30:23.483774       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0717 20:30:23.483782       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	
	
	==> kube-apiserver [f910fbeca2eebc637c9085897f65b8f1c51713acff4ad29cfb0075f1f3ec10bc] <==
	I0717 20:21:45.224098       1 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000
	I0717 20:21:45.224123       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
	I0717 20:21:45.892006       1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0717 20:21:45.936325       1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W0717 20:21:46.045126       1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.76.2]
	I0717 20:21:46.046455       1 controller.go:606] quota admission added evaluator for: endpoints
	I0717 20:21:46.050895       1 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0717 20:21:46.952537       1 controller.go:606] quota admission added evaluator for: serviceaccounts
	I0717 20:21:47.474512       1 controller.go:606] quota admission added evaluator for: deployments.apps
	I0717 20:21:47.571132       1 controller.go:606] quota admission added evaluator for: daemonsets.apps
	I0717 20:21:55.904410       1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
	I0717 20:22:03.215297       1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
	I0717 20:22:03.275030       1 controller.go:606] quota admission added evaluator for: replicasets.apps
	I0717 20:22:12.659749       1 client.go:360] parsed scheme: "passthrough"
	I0717 20:22:12.659791       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0717 20:22:12.659801       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0717 20:22:48.872192       1 client.go:360] parsed scheme: "passthrough"
	I0717 20:22:48.872240       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0717 20:22:48.872249       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0717 20:23:19.775185       1 client.go:360] parsed scheme: "passthrough"
	I0717 20:23:19.775270       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0717 20:23:19.775285       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	I0717 20:23:56.314804       1 client.go:360] parsed scheme: "passthrough"
	I0717 20:23:56.314865       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379  <nil> 0 <nil>}] <nil> <nil>}
	I0717 20:23:56.314874       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
	
	
	==> kube-controller-manager [87f12b148cc5c4d4ab511a09ea624cefb8ca24845ab582cb5171cac706cfab08] <==
	E0717 20:26:37.722993       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0717 20:26:42.093563       1 request.go:655] Throttling request took 1.049910271s, request: GET:https://192.168.76.2:8443/apis/authentication.k8s.io/v1beta1?timeout=32s
	W0717 20:26:42.943787       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0717 20:27:08.225976       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0717 20:27:14.594413       1 request.go:655] Throttling request took 1.04839527s, request: GET:https://192.168.76.2:8443/apis/apiregistration.k8s.io/v1beta1?timeout=32s
	W0717 20:27:15.445878       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0717 20:27:38.727661       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0717 20:27:47.096475       1 request.go:655] Throttling request took 1.048199895s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0717 20:27:47.947896       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0717 20:28:09.229462       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0717 20:28:19.600004       1 request.go:655] Throttling request took 1.046873495s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0717 20:28:20.449732       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0717 20:28:39.731470       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0717 20:28:52.100174       1 request.go:655] Throttling request took 1.048282778s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0717 20:28:52.951617       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0717 20:29:10.233283       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0717 20:29:24.602175       1 request.go:655] Throttling request took 1.048601507s, request: GET:https://192.168.76.2:8443/apis/storage.k8s.io/v1beta1?timeout=32s
	W0717 20:29:25.453567       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0717 20:29:40.734955       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0717 20:29:57.104162       1 request.go:655] Throttling request took 1.048304942s, request: GET:https://192.168.76.2:8443/apis/extensions/v1beta1?timeout=32s
	W0717 20:29:57.955893       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0717 20:30:11.237036       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	I0717 20:30:29.606323       1 request.go:655] Throttling request took 1.048295414s, request: GET:https://192.168.76.2:8443/apis/apiextensions.k8s.io/v1?timeout=32s
	W0717 20:30:30.457834       1 garbagecollector.go:703] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
	E0717 20:30:41.739066       1 resource_quota_controller.go:409] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
	
	
	==> kube-controller-manager [fdcb50d15d02756e4b375373cc89aee7407bf6f49813ed607f9a66e11be2c02f] <==
	I0717 20:22:03.246826       1 shared_informer.go:247] Caches are synced for attach detach 
	I0717 20:22:03.252963       1 shared_informer.go:247] Caches are synced for taint 
	I0717 20:22:03.253185       1 shared_informer.go:247] Caches are synced for deployment 
	I0717 20:22:03.253803       1 taint_manager.go:187] Starting NoExecuteTaintManager
	I0717 20:22:03.254169       1 node_lifecycle_controller.go:1429] Initializing eviction metric for zone: 
	W0717 20:22:03.254260       1 node_lifecycle_controller.go:1044] Missing timestamp for Node old-k8s-version-069806. Assuming now as a timestamp.
	I0717 20:22:03.254320       1 node_lifecycle_controller.go:1245] Controller detected that zone  is now in state Normal.
	I0717 20:22:03.254666       1 event.go:291] "Event occurred" object="old-k8s-version-069806" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node old-k8s-version-069806 event: Registered Node old-k8s-version-069806 in Controller"
	I0717 20:22:03.254752       1 shared_informer.go:247] Caches are synced for PVC protection 
	I0717 20:22:03.256987       1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-mv7j6"
	I0717 20:22:03.261701       1 shared_informer.go:247] Caches are synced for endpoint_slice 
	I0717 20:22:03.262296       1 shared_informer.go:247] Caches are synced for resource quota 
	I0717 20:22:03.300928       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
	I0717 20:22:03.321316       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-9djzb"
	I0717 20:22:03.344715       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-2whzj"
	E0717 20:22:03.383968       1 daemon_controller.go:320] kube-system/kindnet failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kindnet", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"267b013e-888f-4d7a-8693-1f0231327565", ResourceVersion:"266", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63856844508, loc:(*time.Location)(0x632eb80)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{},\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"},\"name\":\"kindnet\",\"namespace\":\"kube-system\"},\"spec\":{\"selector\":{\"matchLabels\":{\"app\":\"k
indnet\"}},\"template\":{\"metadata\":{\"labels\":{\"app\":\"kindnet\",\"k8s-app\":\"kindnet\",\"tier\":\"node\"}},\"spec\":{\"containers\":[{\"env\":[{\"name\":\"HOST_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.hostIP\"}}},{\"name\":\"POD_IP\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"status.podIP\"}}},{\"name\":\"POD_SUBNET\",\"value\":\"10.244.0.0/16\"}],\"image\":\"docker.io/kindest/kindnetd:v20240715-585640e9\",\"name\":\"kindnet-cni\",\"resources\":{\"limits\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"},\"requests\":{\"cpu\":\"100m\",\"memory\":\"50Mi\"}},\"securityContext\":{\"capabilities\":{\"add\":[\"NET_RAW\",\"NET_ADMIN\"]},\"privileged\":false},\"volumeMounts\":[{\"mountPath\":\"/etc/cni/net.d\",\"name\":\"cni-cfg\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\",\"readOnly\":false},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\",\"readOnly\":true}]}],\"hostNetwork\":true,\"serviceAccountName\":\"kindnet\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\
":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/etc/cni/net.d\",\"type\":\"DirectoryOrCreate\"},\"name\":\"cni-cfg\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"}]}}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0x4001a6ef40), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0x4001a6ef60)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0x4001a6ef80), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string
{"app":"kindnet", "k8s-app":"kindnet", "tier":"node"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"cni-cfg", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001a6efa0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil),
FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001a6efc0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.Glust
erfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0x4001a6efe0), EmptyDi
r:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil),
PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kindnet-cni", Image:"docker.io/kindest/kindnetd:v20240715-585640e9", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOST_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001a6f000)}, v1.EnvVar{Name:"POD_IP", Value:"", ValueFrom:(*v1.EnvVarSource)(0x4001a6f040)}, v1.EnvVar{Name:"POD_SUBNET", Value:"10.244.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:
0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}, Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:100, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:52428800, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-cfg", ReadOnly:false, MountPath:"/etc/cni/net.d", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:
(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0x40010f3e00), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0x4001246ec8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"kindnet", DeprecatedServiceAccount:"kindnet", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0x4000acfb20), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}},
HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0x40000fdc90)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0x4001246f10)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kindnet": the object has been modified; please apply your changes to the latest version and try again
	I0717 20:22:03.414357       1 shared_informer.go:240] Waiting for caches to sync for garbage collector
	I0717 20:22:03.708753       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0717 20:22:03.708787       1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0717 20:22:03.728288       1 shared_informer.go:247] Caches are synced for garbage collector 
	I0717 20:22:04.580516       1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
	I0717 20:22:04.596842       1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-2whzj"
	I0717 20:24:09.266583       1 event.go:291] "Event occurred" object="kube-system/metrics-server" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-9975d5f86 to 1"
	I0717 20:24:09.333995       1 event.go:291] "Event occurred" object="kube-system/metrics-server-9975d5f86" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"metrics-server-9975d5f86-\" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount \"metrics-server\" not found"
	E0717 20:24:09.358388       1 replica_set.go:532] sync "kube-system/metrics-server-9975d5f86" failed with pods "metrics-server-9975d5f86-" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount "metrics-server" not found
	
	
	==> kube-proxy [3a29c0026d94090fe1242ea0503bd2f78ae5aa0004fecb1cea584a49f5ddc1f4] <==
	I0717 20:22:05.011638       1 node.go:172] Successfully retrieved node IP: 192.168.76.2
	I0717 20:22:05.011805       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
	W0717 20:22:05.041577       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
	I0717 20:22:05.041702       1 server_others.go:185] Using iptables Proxier.
	I0717 20:22:05.041959       1 server.go:650] Version: v1.20.0
	I0717 20:22:05.042498       1 config.go:315] Starting service config controller
	I0717 20:22:05.042512       1 shared_informer.go:240] Waiting for caches to sync for service config
	I0717 20:22:05.044120       1 config.go:224] Starting endpoint slice config controller
	I0717 20:22:05.044135       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	I0717 20:22:05.142616       1 shared_informer.go:247] Caches are synced for service config 
	I0717 20:22:05.144270       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	
	
	==> kube-proxy [4157f24e3104cf922fe5deb02fbefd7da3728b0bdc290a7c09353bca677fd608] <==
	I0717 20:24:50.406211       1 node.go:172] Successfully retrieved node IP: 192.168.76.2
	I0717 20:24:50.406293       1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.76.2), assume IPv4 operation
	W0717 20:24:50.434128       1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
	I0717 20:24:50.434228       1 server_others.go:185] Using iptables Proxier.
	I0717 20:24:50.434515       1 server.go:650] Version: v1.20.0
	I0717 20:24:50.435119       1 config.go:315] Starting service config controller
	I0717 20:24:50.436903       1 shared_informer.go:240] Waiting for caches to sync for service config
	I0717 20:24:50.435291       1 config.go:224] Starting endpoint slice config controller
	I0717 20:24:50.437200       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
	I0717 20:24:50.538009       1 shared_informer.go:247] Caches are synced for endpoint slice config 
	I0717 20:24:50.538320       1 shared_informer.go:247] Caches are synced for service config 
	
	
	==> kube-scheduler [bcdcb609ea0d91709769d3d302be011074525901ec1c642b6b5f14c7eb1217ef] <==
	W0717 20:21:44.378004       1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0717 20:21:44.378089       1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0717 20:21:44.437175       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
	I0717 20:21:44.441003       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0717 20:21:44.441032       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0717 20:21:44.441049       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	E0717 20:21:44.450727       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0717 20:21:44.452322       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0717 20:21:44.452599       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0717 20:21:44.454417       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0717 20:21:44.462991       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0717 20:21:44.463034       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0717 20:21:44.463147       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0717 20:21:44.463245       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0717 20:21:44.463289       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0717 20:21:44.463331       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0717 20:21:44.463364       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0717 20:21:44.463399       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0717 20:21:45.331562       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0717 20:21:45.393811       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0717 20:21:45.418756       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0717 20:21:45.497572       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0717 20:21:45.541203       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0717 20:21:45.606930       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	I0717 20:21:47.341197       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	
	==> kube-scheduler [d6de24a696fe6c467e60ebcdf508df032838133f4f19467258e96b7f9bfaaf75] <==
	I0717 20:24:40.835164       1 serving.go:331] Generated self-signed cert in-memory
	W0717 20:24:47.055495       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W0717 20:24:47.068599       1 authentication.go:332] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W0717 20:24:47.071530       1 authentication.go:333] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0717 20:24:47.071586       1 authentication.go:334] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0717 20:24:47.495196       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0717 20:24:47.496212       1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0717 20:24:47.500204       1 secure_serving.go:197] Serving securely on 127.0.0.1:10259
	I0717 20:24:47.500293       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	I0717 20:24:47.636296       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	
	==> kubelet <==
	Jul 17 20:29:11 old-k8s-version-069806 kubelet[662]: E0717 20:29:11.874254     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	Jul 17 20:29:12 old-k8s-version-069806 kubelet[662]: E0717 20:29:12.874187     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 17 20:29:26 old-k8s-version-069806 kubelet[662]: I0717 20:29:26.873490     662 scope.go:95] [topologymanager] RemoveContainer - Container ID: 3ca5b52c96d52265da32472b962c89e0ca2efe33f6b1148f0a6a9cb84fcd1004
	Jul 17 20:29:26 old-k8s-version-069806 kubelet[662]: E0717 20:29:26.873840     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	Jul 17 20:29:27 old-k8s-version-069806 kubelet[662]: E0717 20:29:27.875007     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 17 20:29:38 old-k8s-version-069806 kubelet[662]: I0717 20:29:38.873564     662 scope.go:95] [topologymanager] RemoveContainer - Container ID: 3ca5b52c96d52265da32472b962c89e0ca2efe33f6b1148f0a6a9cb84fcd1004
	Jul 17 20:29:38 old-k8s-version-069806 kubelet[662]: E0717 20:29:38.874336     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	Jul 17 20:29:39 old-k8s-version-069806 kubelet[662]: E0717 20:29:39.874118     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 17 20:29:49 old-k8s-version-069806 kubelet[662]: I0717 20:29:49.873403     662 scope.go:95] [topologymanager] RemoveContainer - Container ID: 3ca5b52c96d52265da32472b962c89e0ca2efe33f6b1148f0a6a9cb84fcd1004
	Jul 17 20:29:49 old-k8s-version-069806 kubelet[662]: E0717 20:29:49.873788     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	Jul 17 20:29:53 old-k8s-version-069806 kubelet[662]: E0717 20:29:53.876300     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 17 20:30:02 old-k8s-version-069806 kubelet[662]: I0717 20:30:02.873402     662 scope.go:95] [topologymanager] RemoveContainer - Container ID: 3ca5b52c96d52265da32472b962c89e0ca2efe33f6b1148f0a6a9cb84fcd1004
	Jul 17 20:30:02 old-k8s-version-069806 kubelet[662]: E0717 20:30:02.874275     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	Jul 17 20:30:07 old-k8s-version-069806 kubelet[662]: E0717 20:30:07.874813     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 17 20:30:14 old-k8s-version-069806 kubelet[662]: I0717 20:30:14.873455     662 scope.go:95] [topologymanager] RemoveContainer - Container ID: 3ca5b52c96d52265da32472b962c89e0ca2efe33f6b1148f0a6a9cb84fcd1004
	Jul 17 20:30:14 old-k8s-version-069806 kubelet[662]: E0717 20:30:14.873785     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	Jul 17 20:30:22 old-k8s-version-069806 kubelet[662]: E0717 20:30:22.882718     662 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
	Jul 17 20:30:22 old-k8s-version-069806 kubelet[662]: E0717 20:30:22.883145     662 kuberuntime_image.go:51] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
	Jul 17 20:30:22 old-k8s-version-069806 kubelet[662]: E0717 20:30:22.883375     662 kuberuntime_manager.go:829] container &Container{Name:metrics-server,Image:fake.domain/registry.k8s.io/echoserver:1.4,Command:[],Args:[--cert-dir=/tmp --secure-port=4443 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=60s --kubelet-insecure-tls],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:0,ContainerPort:4443,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{209715200 0} {<nil>}  BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:metrics-server-token-fksnv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{Handler:Handler{Exec
:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{1 0 https},Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc
0-33f0-47c6-a0e7-879ddc760c3c): ErrImagePull: rpc error: code = Unknown desc = failed to pull and unpack image "fake.domain/registry.k8s.io/echoserver:1.4": failed to resolve reference "fake.domain/registry.k8s.io/echoserver:1.4": failed to do request: Head "https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host
	Jul 17 20:30:22 old-k8s-version-069806 kubelet[662]: E0717 20:30:22.883566     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = failed to pull and unpack image \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to resolve reference \"fake.domain/registry.k8s.io/echoserver:1.4\": failed to do request: Head \"https://fake.domain/v2/registry.k8s.io/echoserver/manifests/1.4\": dial tcp: lookup fake.domain on 192.168.76.1:53: no such host"
	Jul 17 20:30:25 old-k8s-version-069806 kubelet[662]: I0717 20:30:25.882213     662 scope.go:95] [topologymanager] RemoveContainer - Container ID: 3ca5b52c96d52265da32472b962c89e0ca2efe33f6b1148f0a6a9cb84fcd1004
	Jul 17 20:30:25 old-k8s-version-069806 kubelet[662]: E0717 20:30:25.883025     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	Jul 17 20:30:33 old-k8s-version-069806 kubelet[662]: E0717 20:30:33.875704     662 pod_workers.go:191] Error syncing pod f6c18fc0-33f0-47c6-a0e7-879ddc760c3c ("metrics-server-9975d5f86-v4sfl_kube-system(f6c18fc0-33f0-47c6-a0e7-879ddc760c3c)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Jul 17 20:30:39 old-k8s-version-069806 kubelet[662]: I0717 20:30:39.873556     662 scope.go:95] [topologymanager] RemoveContainer - Container ID: 3ca5b52c96d52265da32472b962c89e0ca2efe33f6b1148f0a6a9cb84fcd1004
	Jul 17 20:30:39 old-k8s-version-069806 kubelet[662]: E0717 20:30:39.874438     662 pod_workers.go:191] Error syncing pod a167cb8b-0936-4b2c-ac47-7a22fb30f359 ("dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 2m40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-8d5bb5db8-pmx8k_kubernetes-dashboard(a167cb8b-0936-4b2c-ac47-7a22fb30f359)"
	
	
	==> kubernetes-dashboard [44895de2582221beb2740dcf68a96bd5aab3c26b61e7fd33bace4c9538e555f1] <==
	2024/07/17 20:25:12 Using namespace: kubernetes-dashboard
	2024/07/17 20:25:12 Using in-cluster config to connect to apiserver
	2024/07/17 20:25:12 Using secret token for csrf signing
	2024/07/17 20:25:12 Initializing csrf token from kubernetes-dashboard-csrf secret
	2024/07/17 20:25:12 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
	2024/07/17 20:25:12 Successful initial request to the apiserver, version: v1.20.0
	2024/07/17 20:25:12 Generating JWE encryption key
	2024/07/17 20:25:12 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
	2024/07/17 20:25:12 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
	2024/07/17 20:25:14 Initializing JWE encryption key from synchronized object
	2024/07/17 20:25:14 Creating in-cluster Sidecar client
	2024/07/17 20:25:14 Serving insecurely on HTTP port: 9090
	2024/07/17 20:25:14 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/17 20:25:44 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/17 20:26:14 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/17 20:26:44 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/17 20:27:14 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/17 20:27:44 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/17 20:28:14 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/17 20:28:44 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/17 20:29:14 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/17 20:29:44 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/17 20:30:14 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
	2024/07/17 20:25:12 Starting overwatch
	
	
	==> storage-provisioner [57b729d79f17dbcfa3bb0c46429504d8399588e217c6bd8ca2e38947ff5d4cf0] <==
	I0717 20:25:32.088638       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0717 20:25:32.124659       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0717 20:25:32.124711       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0717 20:25:49.596791       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0717 20:25:49.596881       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"fbbce96e-3799-4a46-809b-860f843b678e", APIVersion:"v1", ResourceVersion:"856", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-069806_465facb7-aa0a-4114-a984-49ab52f96775 became leader
	I0717 20:25:49.597493       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-069806_465facb7-aa0a-4114-a984-49ab52f96775!
	I0717 20:25:49.697673       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-069806_465facb7-aa0a-4114-a984-49ab52f96775!
	
	
	==> storage-provisioner [89d02f9d8a4af9b6c7a8ebd5d1b7850c32625b8302d57fba3cc86f4f4b3513f5] <==
	I0717 20:24:49.505148       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	F0717 20:25:19.507458       1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-069806 -n old-k8s-version-069806
helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-069806 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: metrics-server-9975d5f86-v4sfl
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context old-k8s-version-069806 describe pod metrics-server-9975d5f86-v4sfl
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-069806 describe pod metrics-server-9975d5f86-v4sfl: exit status 1 (93.895995ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "metrics-server-9975d5f86-v4sfl" not found

                                                
                                                
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-069806 describe pod metrics-server-9975d5f86-v4sfl: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (381.31s)

                                                
                                    

Test pass (304/336)

Order passed test Duration
3 TestDownloadOnly/v1.20.0/json-events 7
4 TestDownloadOnly/v1.20.0/preload-exists 0
8 TestDownloadOnly/v1.20.0/LogsDuration 0.07
9 TestDownloadOnly/v1.20.0/DeleteAll 0.21
10 TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds 0.13
12 TestDownloadOnly/v1.30.2/json-events 5.48
13 TestDownloadOnly/v1.30.2/preload-exists 0
17 TestDownloadOnly/v1.30.2/LogsDuration 0.07
18 TestDownloadOnly/v1.30.2/DeleteAll 0.19
19 TestDownloadOnly/v1.30.2/DeleteAlwaysSucceeds 0.14
21 TestDownloadOnly/v1.31.0-beta.0/json-events 5.68
22 TestDownloadOnly/v1.31.0-beta.0/preload-exists 0
26 TestDownloadOnly/v1.31.0-beta.0/LogsDuration 0.07
27 TestDownloadOnly/v1.31.0-beta.0/DeleteAll 0.21
28 TestDownloadOnly/v1.31.0-beta.0/DeleteAlwaysSucceeds 0.13
30 TestBinaryMirror 0.56
34 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.06
35 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.08
36 TestAddons/Setup 165.07
38 TestAddons/parallel/Registry 16.37
39 TestAddons/parallel/Ingress 20.42
40 TestAddons/parallel/InspektorGadget 10.81
41 TestAddons/parallel/MetricsServer 5.8
44 TestAddons/parallel/CSI 63.36
45 TestAddons/parallel/Headlamp 11.06
46 TestAddons/parallel/CloudSpanner 6.67
47 TestAddons/parallel/LocalPath 51.64
48 TestAddons/parallel/NvidiaDevicePlugin 5.87
49 TestAddons/parallel/Yakd 6.01
50 TestAddons/parallel/Volcano 175.35
53 TestAddons/serial/GCPAuth/Namespaces 2.35
54 TestAddons/StoppedEnableDisable 12.27
55 TestCertOptions 39.92
56 TestCertExpiration 231.64
58 TestForceSystemdFlag 41.71
59 TestForceSystemdEnv 48.46
60 TestDockerEnvContainerd 44.46
65 TestErrorSpam/setup 29.21
66 TestErrorSpam/start 0.73
67 TestErrorSpam/status 0.97
68 TestErrorSpam/pause 1.65
69 TestErrorSpam/unpause 1.85
70 TestErrorSpam/stop 1.4
73 TestFunctional/serial/CopySyncFile 0
74 TestFunctional/serial/StartWithProxy 61.9
75 TestFunctional/serial/AuditLog 0
76 TestFunctional/serial/SoftStart 6.32
77 TestFunctional/serial/KubeContext 0.06
78 TestFunctional/serial/KubectlGetPods 0.09
81 TestFunctional/serial/CacheCmd/cache/add_remote 4.63
82 TestFunctional/serial/CacheCmd/cache/add_local 1.42
83 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.06
84 TestFunctional/serial/CacheCmd/cache/list 0.06
85 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.31
86 TestFunctional/serial/CacheCmd/cache/cache_reload 2.2
87 TestFunctional/serial/CacheCmd/cache/delete 0.11
88 TestFunctional/serial/MinikubeKubectlCmd 0.13
89 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.13
90 TestFunctional/serial/ExtraConfig 72.19
91 TestFunctional/serial/ComponentHealth 0.09
92 TestFunctional/serial/LogsCmd 1.73
93 TestFunctional/serial/LogsFileCmd 1.94
94 TestFunctional/serial/InvalidService 4.11
96 TestFunctional/parallel/ConfigCmd 0.5
97 TestFunctional/parallel/DashboardCmd 10.96
98 TestFunctional/parallel/DryRun 0.46
99 TestFunctional/parallel/InternationalLanguage 0.23
100 TestFunctional/parallel/StatusCmd 1.25
104 TestFunctional/parallel/ServiceCmdConnect 9.64
105 TestFunctional/parallel/AddonsCmd 0.18
106 TestFunctional/parallel/PersistentVolumeClaim 25.12
108 TestFunctional/parallel/SSHCmd 0.64
109 TestFunctional/parallel/CpCmd 2.26
111 TestFunctional/parallel/FileSync 0.34
112 TestFunctional/parallel/CertSync 2.26
116 TestFunctional/parallel/NodeLabels 0.11
118 TestFunctional/parallel/NonActiveRuntimeDisabled 0.59
120 TestFunctional/parallel/License 0.25
122 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.67
123 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
125 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 9.43
126 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.1
127 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
131 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
132 TestFunctional/parallel/ServiceCmd/DeployApp 6.23
133 TestFunctional/parallel/ProfileCmd/profile_not_create 0.51
134 TestFunctional/parallel/ServiceCmd/List 0.62
135 TestFunctional/parallel/ProfileCmd/profile_list 0.47
136 TestFunctional/parallel/ServiceCmd/JSONOutput 0.65
137 TestFunctional/parallel/ProfileCmd/profile_json_output 0.49
138 TestFunctional/parallel/ServiceCmd/HTTPS 0.51
139 TestFunctional/parallel/MountCmd/any-port 7.44
140 TestFunctional/parallel/ServiceCmd/Format 0.41
141 TestFunctional/parallel/ServiceCmd/URL 0.43
142 TestFunctional/parallel/MountCmd/specific-port 2.2
143 TestFunctional/parallel/MountCmd/VerifyCleanup 2.45
144 TestFunctional/parallel/Version/short 0.11
145 TestFunctional/parallel/Version/components 1.35
146 TestFunctional/parallel/ImageCommands/ImageListShort 0.29
147 TestFunctional/parallel/ImageCommands/ImageListTable 0.26
148 TestFunctional/parallel/ImageCommands/ImageListJson 0.3
149 TestFunctional/parallel/ImageCommands/ImageListYaml 0.28
150 TestFunctional/parallel/ImageCommands/ImageBuild 2.98
151 TestFunctional/parallel/ImageCommands/Setup 0.73
152 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 1.77
153 TestFunctional/parallel/UpdateContextCmd/no_changes 0.21
154 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.22
155 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.19
156 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 1.51
157 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 1.65
158 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.75
159 TestFunctional/parallel/ImageCommands/ImageRemove 0.48
160 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.68
161 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.73
162 TestFunctional/delete_echo-server_images 0.04
163 TestFunctional/delete_my-image_image 0.02
164 TestFunctional/delete_minikube_cached_images 0.02
168 TestMultiControlPlane/serial/StartCluster 125.76
169 TestMultiControlPlane/serial/DeployApp 32.82
170 TestMultiControlPlane/serial/PingHostFromPods 1.68
171 TestMultiControlPlane/serial/AddWorkerNode 24.29
172 TestMultiControlPlane/serial/NodeLabels 0.11
173 TestMultiControlPlane/serial/HAppyAfterClusterStart 0.74
174 TestMultiControlPlane/serial/CopyFile 18.96
175 TestMultiControlPlane/serial/StopSecondaryNode 12.94
176 TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop 0.56
177 TestMultiControlPlane/serial/RestartSecondaryNode 18.71
178 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart 0.76
179 TestMultiControlPlane/serial/RestartClusterKeepsNodes 138.51
180 TestMultiControlPlane/serial/DeleteSecondaryNode 10.95
181 TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete 0.53
182 TestMultiControlPlane/serial/StopCluster 36.27
183 TestMultiControlPlane/serial/RestartCluster 78.34
184 TestMultiControlPlane/serial/DegradedAfterClusterRestart 0.53
185 TestMultiControlPlane/serial/AddSecondaryNode 47.04
186 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd 0.76
190 TestJSONOutput/start/Command 58.97
191 TestJSONOutput/start/Audit 0
193 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
194 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
196 TestJSONOutput/pause/Command 0.74
197 TestJSONOutput/pause/Audit 0
199 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
200 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
202 TestJSONOutput/unpause/Command 0.68
203 TestJSONOutput/unpause/Audit 0
205 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
206 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
208 TestJSONOutput/stop/Command 5.82
209 TestJSONOutput/stop/Audit 0
211 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
212 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
213 TestErrorJSONOutput 0.22
215 TestKicCustomNetwork/create_custom_network 38.44
216 TestKicCustomNetwork/use_default_bridge_network 33.44
217 TestKicExistingNetwork 35.59
218 TestKicCustomSubnet 36.48
219 TestKicStaticIP 35.58
220 TestMainNoArgs 0.05
221 TestMinikubeProfile 73
224 TestMountStart/serial/StartWithMountFirst 6.65
225 TestMountStart/serial/VerifyMountFirst 0.25
226 TestMountStart/serial/StartWithMountSecond 9.1
227 TestMountStart/serial/VerifyMountSecond 0.24
228 TestMountStart/serial/DeleteFirst 1.79
229 TestMountStart/serial/VerifyMountPostDelete 0.26
230 TestMountStart/serial/Stop 1.2
231 TestMountStart/serial/RestartStopped 8.15
232 TestMountStart/serial/VerifyMountPostStop 0.25
235 TestMultiNode/serial/FreshStart2Nodes 76.75
236 TestMultiNode/serial/DeployApp2Nodes 16.47
237 TestMultiNode/serial/PingHostFrom2Pods 0.99
238 TestMultiNode/serial/AddNode 16.74
239 TestMultiNode/serial/MultiNodeLabels 0.09
240 TestMultiNode/serial/ProfileList 0.33
241 TestMultiNode/serial/CopyFile 9.86
242 TestMultiNode/serial/StopNode 2.22
243 TestMultiNode/serial/StartAfterStop 9.46
244 TestMultiNode/serial/RestartKeepsNodes 89.23
245 TestMultiNode/serial/DeleteNode 5.75
246 TestMultiNode/serial/StopMultiNode 24.08
247 TestMultiNode/serial/RestartMultiNode 56.13
248 TestMultiNode/serial/ValidateNameConflict 35.43
253 TestPreload 110.49
255 TestScheduledStopUnix 109.35
258 TestInsufficientStorage 10.34
259 TestRunningBinaryUpgrade 87.19
261 TestKubernetesUpgrade 359.11
262 TestMissingContainerUpgrade 166.89
264 TestPause/serial/Start 73.95
266 TestNoKubernetes/serial/StartNoK8sWithVersion 0.09
267 TestNoKubernetes/serial/StartWithK8s 42.73
268 TestNoKubernetes/serial/StartWithStopK8s 17.4
269 TestNoKubernetes/serial/Start 7.98
270 TestNoKubernetes/serial/VerifyK8sNotRunning 0.26
271 TestNoKubernetes/serial/ProfileList 1.15
272 TestNoKubernetes/serial/Stop 1.23
273 TestNoKubernetes/serial/StartNoArgs 7.17
274 TestPause/serial/SecondStartNoReconfiguration 6.97
275 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.36
276 TestPause/serial/Pause 0.87
277 TestPause/serial/VerifyStatus 0.32
278 TestPause/serial/Unpause 0.99
279 TestPause/serial/PauseAgain 1.2
280 TestPause/serial/DeletePaused 4.45
281 TestPause/serial/VerifyDeletedResources 0.12
282 TestStoppedBinaryUpgrade/Setup 0.62
283 TestStoppedBinaryUpgrade/Upgrade 95.95
284 TestStoppedBinaryUpgrade/MinikubeLogs 1.29
299 TestNetworkPlugins/group/false 4.7
304 TestStartStop/group/old-k8s-version/serial/FirstStart 175.31
306 TestStartStop/group/no-preload/serial/FirstStart 73.37
307 TestStartStop/group/old-k8s-version/serial/DeployApp 9.8
308 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 1.4
309 TestStartStop/group/old-k8s-version/serial/Stop 12.4
310 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.21
312 TestStartStop/group/no-preload/serial/DeployApp 8.42
313 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 1.18
314 TestStartStop/group/no-preload/serial/Stop 12.63
315 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.21
316 TestStartStop/group/no-preload/serial/SecondStart 268.41
317 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 6.01
318 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 6.11
319 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.25
320 TestStartStop/group/no-preload/serial/Pause 3.25
322 TestStartStop/group/embed-certs/serial/FirstStart 74.15
323 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 6
324 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.1
325 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.23
326 TestStartStop/group/old-k8s-version/serial/Pause 2.98
328 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 63.78
329 TestStartStop/group/embed-certs/serial/DeployApp 8.48
330 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 1.75
331 TestStartStop/group/embed-certs/serial/Stop 12.44
332 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.24
333 TestStartStop/group/embed-certs/serial/SecondStart 269.31
334 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 8.4
335 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 1.3
336 TestStartStop/group/default-k8s-diff-port/serial/Stop 12.09
337 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.21
338 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 268.91
339 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 6.01
340 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.1
341 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.25
342 TestStartStop/group/embed-certs/serial/Pause 3.19
344 TestStartStop/group/newest-cni/serial/FirstStart 38.89
345 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 6.01
346 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 6.16
347 TestStartStop/group/newest-cni/serial/DeployApp 0
348 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 1.46
349 TestStartStop/group/newest-cni/serial/Stop 1.29
350 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.24
351 TestStartStop/group/newest-cni/serial/SecondStart 24.67
352 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.29
353 TestStartStop/group/default-k8s-diff-port/serial/Pause 3.39
354 TestNetworkPlugins/group/auto/Start 87.81
355 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
356 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
357 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.31
358 TestStartStop/group/newest-cni/serial/Pause 3.83
359 TestNetworkPlugins/group/kindnet/Start 78.36
360 TestNetworkPlugins/group/auto/KubeletFlags 0.29
361 TestNetworkPlugins/group/auto/NetCatPod 10.33
362 TestNetworkPlugins/group/auto/DNS 0.2
363 TestNetworkPlugins/group/auto/Localhost 0.18
364 TestNetworkPlugins/group/auto/HairPin 0.16
365 TestNetworkPlugins/group/kindnet/ControllerPod 6.01
366 TestNetworkPlugins/group/kindnet/KubeletFlags 0.4
367 TestNetworkPlugins/group/kindnet/NetCatPod 10.41
368 TestNetworkPlugins/group/kindnet/DNS 0.26
369 TestNetworkPlugins/group/kindnet/Localhost 0.17
370 TestNetworkPlugins/group/kindnet/HairPin 0.2
371 TestNetworkPlugins/group/calico/Start 81.81
372 TestNetworkPlugins/group/custom-flannel/Start 67.58
373 TestNetworkPlugins/group/calico/ControllerPod 6.01
374 TestNetworkPlugins/group/calico/KubeletFlags 0.29
375 TestNetworkPlugins/group/calico/NetCatPod 11.32
376 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.38
377 TestNetworkPlugins/group/custom-flannel/NetCatPod 10.32
378 TestNetworkPlugins/group/calico/DNS 0.22
379 TestNetworkPlugins/group/calico/Localhost 0.16
380 TestNetworkPlugins/group/calico/HairPin 0.15
381 TestNetworkPlugins/group/custom-flannel/DNS 0.2
382 TestNetworkPlugins/group/custom-flannel/Localhost 0.22
383 TestNetworkPlugins/group/custom-flannel/HairPin 0.18
384 TestNetworkPlugins/group/enable-default-cni/Start 63.06
385 TestNetworkPlugins/group/flannel/Start 68.54
386 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.3
387 TestNetworkPlugins/group/enable-default-cni/NetCatPod 10.27
388 TestNetworkPlugins/group/flannel/ControllerPod 6.01
389 TestNetworkPlugins/group/enable-default-cni/DNS 0.18
390 TestNetworkPlugins/group/enable-default-cni/Localhost 0.15
391 TestNetworkPlugins/group/enable-default-cni/HairPin 0.15
392 TestNetworkPlugins/group/flannel/KubeletFlags 0.3
393 TestNetworkPlugins/group/flannel/NetCatPod 9.27
394 TestNetworkPlugins/group/flannel/DNS 0.22
395 TestNetworkPlugins/group/flannel/Localhost 0.2
396 TestNetworkPlugins/group/flannel/HairPin 0.19
397 TestNetworkPlugins/group/bridge/Start 60.32
398 TestNetworkPlugins/group/bridge/KubeletFlags 0.28
399 TestNetworkPlugins/group/bridge/NetCatPod 9.26
400 TestNetworkPlugins/group/bridge/DNS 0.17
401 TestNetworkPlugins/group/bridge/Localhost 0.13
402 TestNetworkPlugins/group/bridge/HairPin 0.14
x
+
TestDownloadOnly/v1.20.0/json-events (7s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-763027 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-763027 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (6.996099434s)
--- PASS: TestDownloadOnly/v1.20.0/json-events (7.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/preload-exists
--- PASS: TestDownloadOnly/v1.20.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-763027
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-763027: exit status 85 (67.09819ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-763027 | jenkins | v1.33.1 | 17 Jul 24 19:35 UTC |          |
	|         | -p download-only-763027        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	
	==> Last Start <==
	Log file created at: 2024/07/17 19:35:09
	Running on machine: ip-172-31-30-239
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0717 19:35:09.804812  726230 out.go:291] Setting OutFile to fd 1 ...
	I0717 19:35:09.804951  726230 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 19:35:09.804963  726230 out.go:304] Setting ErrFile to fd 2...
	I0717 19:35:09.804969  726230 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 19:35:09.805220  726230 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
	W0717 19:35:09.805352  726230 root.go:314] Error reading config file at /home/jenkins/minikube-integration/19282-720845/.minikube/config/config.json: open /home/jenkins/minikube-integration/19282-720845/.minikube/config/config.json: no such file or directory
	I0717 19:35:09.805771  726230 out.go:298] Setting JSON to true
	I0717 19:35:09.806731  726230 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":11858,"bootTime":1721233052,"procs":186,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0717 19:35:09.806806  726230 start.go:139] virtualization:  
	I0717 19:35:09.809641  726230 out.go:97] [download-only-763027] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	W0717 19:35:09.809820  726230 preload.go:293] Failed to list preload files: open /home/jenkins/minikube-integration/19282-720845/.minikube/cache/preloaded-tarball: no such file or directory
	I0717 19:35:09.809883  726230 notify.go:220] Checking for updates...
	I0717 19:35:09.811442  726230 out.go:169] MINIKUBE_LOCATION=19282
	I0717 19:35:09.813501  726230 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 19:35:09.816171  726230 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig
	I0717 19:35:09.818276  726230 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube
	I0717 19:35:09.820133  726230 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0717 19:35:09.823910  726230 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0717 19:35:09.824321  726230 driver.go:392] Setting default libvirt URI to qemu:///system
	I0717 19:35:09.856214  726230 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0717 19:35:09.856316  726230 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 19:35:09.912437  726230 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:50 SystemTime:2024-07-17 19:35:09.902961096 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0717 19:35:09.912552  726230 docker.go:307] overlay module found
	I0717 19:35:09.914589  726230 out.go:97] Using the docker driver based on user configuration
	I0717 19:35:09.914615  726230 start.go:297] selected driver: docker
	I0717 19:35:09.914622  726230 start.go:901] validating driver "docker" against <nil>
	I0717 19:35:09.914744  726230 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 19:35:09.973400  726230 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:50 SystemTime:2024-07-17 19:35:09.964246743 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0717 19:35:09.973564  726230 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0717 19:35:09.973906  726230 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0717 19:35:09.974075  726230 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0717 19:35:09.976258  726230 out.go:169] Using Docker driver with root privileges
	I0717 19:35:09.978013  726230 cni.go:84] Creating CNI manager for ""
	I0717 19:35:09.978036  726230 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 19:35:09.978048  726230 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0717 19:35:09.978157  726230 start.go:340] cluster config:
	{Name:download-only-763027 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-763027 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0717 19:35:09.980320  726230 out.go:97] Starting "download-only-763027" primary control-plane node in "download-only-763027" cluster
	I0717 19:35:09.980346  726230 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0717 19:35:09.982074  726230 out.go:97] Pulling base image v0.0.44-1721234491-19282 ...
	I0717 19:35:09.982104  726230 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0717 19:35:09.982287  726230 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 in local docker daemon
	I0717 19:35:10.001267  726230 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 to local cache
	I0717 19:35:10.001472  726230 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 in local cache directory
	I0717 19:35:10.001576  726230 image.go:148] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 to local cache
	I0717 19:35:10.043088  726230 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
	I0717 19:35:10.043128  726230 cache.go:56] Caching tarball of preloaded images
	I0717 19:35:10.043354  726230 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime containerd
	I0717 19:35:10.046109  726230 out.go:97] Downloading Kubernetes v1.20.0 preload ...
	I0717 19:35:10.046147  726230 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4 ...
	I0717 19:35:10.161818  726230 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4?checksum=md5:7e3d48ccb9f143791669d02e14ce1643 -> /home/jenkins/minikube-integration/19282-720845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-containerd-overlay2-arm64.tar.lz4
	I0717 19:35:14.602551  726230 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 as a tarball
	
	
	* The control-plane node download-only-763027 host does not exist
	  To start a cluster, run: "minikube start -p download-only-763027"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.20.0/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAll (0.21s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.20.0/DeleteAll (0.21s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-763027
--- PASS: TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.2/json-events (5.48s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.2/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-300972 --force --alsologtostderr --kubernetes-version=v1.30.2 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-300972 --force --alsologtostderr --kubernetes-version=v1.30.2 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (5.474797127s)
--- PASS: TestDownloadOnly/v1.30.2/json-events (5.48s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.2/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.2/preload-exists
--- PASS: TestDownloadOnly/v1.30.2/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.2/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.2/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-300972
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-300972: exit status 85 (67.543135ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-763027 | jenkins | v1.33.1 | 17 Jul 24 19:35 UTC |                     |
	|         | -p download-only-763027        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	| delete  | --all                          | minikube             | jenkins | v1.33.1 | 17 Jul 24 19:35 UTC | 17 Jul 24 19:35 UTC |
	| delete  | -p download-only-763027        | download-only-763027 | jenkins | v1.33.1 | 17 Jul 24 19:35 UTC | 17 Jul 24 19:35 UTC |
	| start   | -o=json --download-only        | download-only-300972 | jenkins | v1.33.1 | 17 Jul 24 19:35 UTC |                     |
	|         | -p download-only-300972        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.30.2   |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=containerd |                      |         |         |                     |                     |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/07/17 19:35:17
	Running on machine: ip-172-31-30-239
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0717 19:35:17.212615  726434 out.go:291] Setting OutFile to fd 1 ...
	I0717 19:35:17.212828  726434 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 19:35:17.212855  726434 out.go:304] Setting ErrFile to fd 2...
	I0717 19:35:17.212874  726434 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 19:35:17.213167  726434 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
	I0717 19:35:17.213628  726434 out.go:298] Setting JSON to true
	I0717 19:35:17.214593  726434 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":11865,"bootTime":1721233052,"procs":184,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0717 19:35:17.214694  726434 start.go:139] virtualization:  
	I0717 19:35:17.216864  726434 out.go:97] [download-only-300972] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0717 19:35:17.217071  726434 notify.go:220] Checking for updates...
	I0717 19:35:17.219186  726434 out.go:169] MINIKUBE_LOCATION=19282
	I0717 19:35:17.221127  726434 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 19:35:17.222977  726434 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig
	I0717 19:35:17.225007  726434 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube
	I0717 19:35:17.227107  726434 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0717 19:35:17.231407  726434 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0717 19:35:17.231736  726434 driver.go:392] Setting default libvirt URI to qemu:///system
	I0717 19:35:17.259007  726434 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0717 19:35:17.259120  726434 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 19:35:17.312583  726434 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:45 SystemTime:2024-07-17 19:35:17.302564905 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0717 19:35:17.312696  726434 docker.go:307] overlay module found
	I0717 19:35:17.314693  726434 out.go:97] Using the docker driver based on user configuration
	I0717 19:35:17.314723  726434 start.go:297] selected driver: docker
	I0717 19:35:17.314730  726434 start.go:901] validating driver "docker" against <nil>
	I0717 19:35:17.314842  726434 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 19:35:17.364702  726434 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:45 SystemTime:2024-07-17 19:35:17.355128367 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0717 19:35:17.364855  726434 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0717 19:35:17.365150  726434 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0717 19:35:17.365308  726434 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0717 19:35:17.367545  726434 out.go:169] Using Docker driver with root privileges
	I0717 19:35:17.369216  726434 cni.go:84] Creating CNI manager for ""
	I0717 19:35:17.369236  726434 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 19:35:17.369248  726434 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0717 19:35:17.369339  726434 start.go:340] cluster config:
	{Name:download-only-300972 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:download-only-300972 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0717 19:35:17.371120  726434 out.go:97] Starting "download-only-300972" primary control-plane node in "download-only-300972" cluster
	I0717 19:35:17.371141  726434 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0717 19:35:17.372999  726434 out.go:97] Pulling base image v0.0.44-1721234491-19282 ...
	I0717 19:35:17.373034  726434 preload.go:131] Checking if preload exists for k8s version v1.30.2 and runtime containerd
	I0717 19:35:17.373133  726434 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 in local docker daemon
	I0717 19:35:17.388004  726434 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 to local cache
	I0717 19:35:17.388168  726434 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 in local cache directory
	I0717 19:35:17.388186  726434 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 in local cache directory, skipping pull
	I0717 19:35:17.388196  726434 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 exists in cache, skipping pull
	I0717 19:35:17.388205  726434 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 as a tarball
	I0717 19:35:17.436658  726434 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.30.2/preloaded-images-k8s-v18-v1.30.2-containerd-overlay2-arm64.tar.lz4
	I0717 19:35:17.436685  726434 cache.go:56] Caching tarball of preloaded images
	I0717 19:35:17.436853  726434 preload.go:131] Checking if preload exists for k8s version v1.30.2 and runtime containerd
	I0717 19:35:17.439423  726434 out.go:97] Downloading Kubernetes v1.30.2 preload ...
	I0717 19:35:17.439474  726434 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.30.2-containerd-overlay2-arm64.tar.lz4 ...
	I0717 19:35:17.521212  726434 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.30.2/preloaded-images-k8s-v18-v1.30.2-containerd-overlay2-arm64.tar.lz4?checksum=md5:5f38272c206cc90312ddc23a9bcf8a1f -> /home/jenkins/minikube-integration/19282-720845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-containerd-overlay2-arm64.tar.lz4
	I0717 19:35:21.056121  726434 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.30.2-containerd-overlay2-arm64.tar.lz4 ...
	I0717 19:35:21.056243  726434 preload.go:254] verifying checksum of /home/jenkins/minikube-integration/19282-720845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-containerd-overlay2-arm64.tar.lz4 ...
	I0717 19:35:21.978667  726434 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on containerd
	I0717 19:35:21.979048  726434 profile.go:143] Saving config to /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/download-only-300972/config.json ...
	I0717 19:35:21.979082  726434 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/download-only-300972/config.json: {Name:mk12cf2b440f5004f840553420eaf4f6a4070353 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 19:35:21.979298  726434 preload.go:131] Checking if preload exists for k8s version v1.30.2 and runtime containerd
	I0717 19:35:21.979474  726434 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.2/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/arm64/kubectl.sha256 -> /home/jenkins/minikube-integration/19282-720845/.minikube/cache/linux/arm64/v1.30.2/kubectl
	
	
	* The control-plane node download-only-300972 host does not exist
	  To start a cluster, run: "minikube start -p download-only-300972"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.30.2/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.2/DeleteAll (0.19s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.2/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.30.2/DeleteAll (0.19s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.2/DeleteAlwaysSucceeds (0.14s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.2/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-300972
--- PASS: TestDownloadOnly/v1.30.2/DeleteAlwaysSucceeds (0.14s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/json-events (5.68s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-881484 --force --alsologtostderr --kubernetes-version=v1.31.0-beta.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-881484 --force --alsologtostderr --kubernetes-version=v1.31.0-beta.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (5.681150727s)
--- PASS: TestDownloadOnly/v1.31.0-beta.0/json-events (5.68s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/preload-exists
--- PASS: TestDownloadOnly/v1.31.0-beta.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-881484
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-881484: exit status 85 (70.823232ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|-------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |                Args                 |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|-------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only             | download-only-763027 | jenkins | v1.33.1 | 17 Jul 24 19:35 UTC |                     |
	|         | -p download-only-763027             |                      |         |         |                     |                     |
	|         | --force --alsologtostderr           |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0        |                      |         |         |                     |                     |
	|         | --container-runtime=containerd      |                      |         |         |                     |                     |
	|         | --driver=docker                     |                      |         |         |                     |                     |
	|         | --container-runtime=containerd      |                      |         |         |                     |                     |
	| delete  | --all                               | minikube             | jenkins | v1.33.1 | 17 Jul 24 19:35 UTC | 17 Jul 24 19:35 UTC |
	| delete  | -p download-only-763027             | download-only-763027 | jenkins | v1.33.1 | 17 Jul 24 19:35 UTC | 17 Jul 24 19:35 UTC |
	| start   | -o=json --download-only             | download-only-300972 | jenkins | v1.33.1 | 17 Jul 24 19:35 UTC |                     |
	|         | -p download-only-300972             |                      |         |         |                     |                     |
	|         | --force --alsologtostderr           |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.30.2        |                      |         |         |                     |                     |
	|         | --container-runtime=containerd      |                      |         |         |                     |                     |
	|         | --driver=docker                     |                      |         |         |                     |                     |
	|         | --container-runtime=containerd      |                      |         |         |                     |                     |
	| delete  | --all                               | minikube             | jenkins | v1.33.1 | 17 Jul 24 19:35 UTC | 17 Jul 24 19:35 UTC |
	| delete  | -p download-only-300972             | download-only-300972 | jenkins | v1.33.1 | 17 Jul 24 19:35 UTC | 17 Jul 24 19:35 UTC |
	| start   | -o=json --download-only             | download-only-881484 | jenkins | v1.33.1 | 17 Jul 24 19:35 UTC |                     |
	|         | -p download-only-881484             |                      |         |         |                     |                     |
	|         | --force --alsologtostderr           |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.31.0-beta.0 |                      |         |         |                     |                     |
	|         | --container-runtime=containerd      |                      |         |         |                     |                     |
	|         | --driver=docker                     |                      |         |         |                     |                     |
	|         | --container-runtime=containerd      |                      |         |         |                     |                     |
	|---------|-------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/07/17 19:35:23
	Running on machine: ip-172-31-30-239
	Binary: Built with gc go1.22.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0717 19:35:23.089850  726637 out.go:291] Setting OutFile to fd 1 ...
	I0717 19:35:23.090041  726637 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 19:35:23.090068  726637 out.go:304] Setting ErrFile to fd 2...
	I0717 19:35:23.090088  726637 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 19:35:23.090378  726637 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
	I0717 19:35:23.090813  726637 out.go:298] Setting JSON to true
	I0717 19:35:23.091747  726637 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":11871,"bootTime":1721233052,"procs":184,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0717 19:35:23.091849  726637 start.go:139] virtualization:  
	I0717 19:35:23.094347  726637 out.go:97] [download-only-881484] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0717 19:35:23.094565  726637 notify.go:220] Checking for updates...
	I0717 19:35:23.096165  726637 out.go:169] MINIKUBE_LOCATION=19282
	I0717 19:35:23.098009  726637 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 19:35:23.099983  726637 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig
	I0717 19:35:23.102190  726637 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube
	I0717 19:35:23.104309  726637 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0717 19:35:23.108212  726637 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0717 19:35:23.108499  726637 driver.go:392] Setting default libvirt URI to qemu:///system
	I0717 19:35:23.134113  726637 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0717 19:35:23.134211  726637 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 19:35:23.193357  726637 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-17 19:35:23.183147964 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0717 19:35:23.193466  726637 docker.go:307] overlay module found
	I0717 19:35:23.195184  726637 out.go:97] Using the docker driver based on user configuration
	I0717 19:35:23.195214  726637 start.go:297] selected driver: docker
	I0717 19:35:23.195222  726637 start.go:901] validating driver "docker" against <nil>
	I0717 19:35:23.195343  726637 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 19:35:23.257906  726637 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-07-17 19:35:23.248230364 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0717 19:35:23.258081  726637 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0717 19:35:23.258393  726637 start_flags.go:393] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0717 19:35:23.258568  726637 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0717 19:35:23.260911  726637 out.go:169] Using Docker driver with root privileges
	I0717 19:35:23.263019  726637 cni.go:84] Creating CNI manager for ""
	I0717 19:35:23.263050  726637 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 19:35:23.263062  726637 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0717 19:35:23.263167  726637 start.go:340] cluster config:
	{Name:download-only-881484 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0-beta.0 ClusterName:download-only-881484 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l
ocal ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0-beta.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval
:1m0s}
	I0717 19:35:23.264990  726637 out.go:97] Starting "download-only-881484" primary control-plane node in "download-only-881484" cluster
	I0717 19:35:23.265020  726637 cache.go:121] Beginning downloading kic base image for docker with containerd
	I0717 19:35:23.267120  726637 out.go:97] Pulling base image v0.0.44-1721234491-19282 ...
	I0717 19:35:23.267158  726637 preload.go:131] Checking if preload exists for k8s version v1.31.0-beta.0 and runtime containerd
	I0717 19:35:23.267337  726637 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 in local docker daemon
	I0717 19:35:23.282958  726637 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 to local cache
	I0717 19:35:23.283092  726637 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 in local cache directory
	I0717 19:35:23.283116  726637 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 in local cache directory, skipping pull
	I0717 19:35:23.283121  726637 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 exists in cache, skipping pull
	I0717 19:35:23.283136  726637 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 as a tarball
	I0717 19:35:23.340884  726637 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.0-beta.0/preloaded-images-k8s-v18-v1.31.0-beta.0-containerd-overlay2-arm64.tar.lz4
	I0717 19:35:23.340917  726637 cache.go:56] Caching tarball of preloaded images
	I0717 19:35:23.341089  726637 preload.go:131] Checking if preload exists for k8s version v1.31.0-beta.0 and runtime containerd
	I0717 19:35:23.343435  726637 out.go:97] Downloading Kubernetes v1.31.0-beta.0 preload ...
	I0717 19:35:23.343463  726637 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.31.0-beta.0-containerd-overlay2-arm64.tar.lz4 ...
	I0717 19:35:23.433625  726637 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.31.0-beta.0/preloaded-images-k8s-v18-v1.31.0-beta.0-containerd-overlay2-arm64.tar.lz4?checksum=md5:e1550e32e6115d92010b4a739f5f0833 -> /home/jenkins/minikube-integration/19282-720845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-beta.0-containerd-overlay2-arm64.tar.lz4
	I0717 19:35:27.063221  726637 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.31.0-beta.0-containerd-overlay2-arm64.tar.lz4 ...
	I0717 19:35:27.063360  726637 preload.go:254] verifying checksum of /home/jenkins/minikube-integration/19282-720845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-beta.0-containerd-overlay2-arm64.tar.lz4 ...
	I0717 19:35:28.016065  726637 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0-beta.0 on containerd
	I0717 19:35:28.016461  726637 profile.go:143] Saving config to /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/download-only-881484/config.json ...
	I0717 19:35:28.016509  726637 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/download-only-881484/config.json: {Name:mk53192eb739cc420caf305b8bc8d6cfcc55f2b5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 19:35:28.016750  726637 preload.go:131] Checking if preload exists for k8s version v1.31.0-beta.0 and runtime containerd
	I0717 19:35:28.016968  726637 download.go:107] Downloading: https://dl.k8s.io/release/v1.31.0-beta.0/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.0-beta.0/bin/linux/arm64/kubectl.sha256 -> /home/jenkins/minikube-integration/19282-720845/.minikube/cache/linux/arm64/v1.31.0-beta.0/kubectl
	
	
	* The control-plane node download-only-881484 host does not exist
	  To start a cluster, run: "minikube start -p download-only-881484"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.31.0-beta.0/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/DeleteAll (0.21s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/v1.31.0-beta.0/DeleteAll (0.21s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-881484
--- PASS: TestDownloadOnly/v1.31.0-beta.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                    
x
+
TestBinaryMirror (0.56s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:314: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-528831 --alsologtostderr --binary-mirror http://127.0.0.1:46457 --driver=docker  --container-runtime=containerd
helpers_test.go:175: Cleaning up "binary-mirror-528831" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-528831
--- PASS: TestBinaryMirror (0.56s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.06s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:1029: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-543596
addons_test.go:1029: (dbg) Non-zero exit: out/minikube-linux-arm64 addons enable dashboard -p addons-543596: exit status 85 (57.896376ms)

                                                
                                                
-- stdout --
	* Profile "addons-543596" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-543596"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.06s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.08s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:1040: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-543596
addons_test.go:1040: (dbg) Non-zero exit: out/minikube-linux-arm64 addons disable dashboard -p addons-543596: exit status 85 (81.410466ms)

                                                
                                                
-- stdout --
	* Profile "addons-543596" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-543596"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.08s)

                                                
                                    
x
+
TestAddons/Setup (165.07s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:110: (dbg) Run:  out/minikube-linux-arm64 start -p addons-543596 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns
addons_test.go:110: (dbg) Done: out/minikube-linux-arm64 start -p addons-543596 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns: (2m45.066362351s)
--- PASS: TestAddons/Setup (165.07s)

                                                
                                    
x
+
TestAddons/parallel/Registry (16.37s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:332: registry stabilized in 43.030944ms
addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-656c9c8d9c-vlpdp" [ebe9f894-37c8-4e63-9d50-79a134caecf7] Running
addons_test.go:334: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 6.005403759s
addons_test.go:337: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-xjz4g" [a981fedd-1905-494c-96dd-fb005de8ac9b] Running
addons_test.go:337: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 6.004732586s
addons_test.go:342: (dbg) Run:  kubectl --context addons-543596 delete po -l run=registry-test --now
addons_test.go:347: (dbg) Run:  kubectl --context addons-543596 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:347: (dbg) Done: kubectl --context addons-543596 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.234870773s)
addons_test.go:361: (dbg) Run:  out/minikube-linux-arm64 -p addons-543596 ip
2024/07/17 19:38:31 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:390: (dbg) Run:  out/minikube-linux-arm64 -p addons-543596 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (16.37s)

                                                
                                    
x
+
TestAddons/parallel/Ingress (20.42s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:209: (dbg) Run:  kubectl --context addons-543596 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:234: (dbg) Run:  kubectl --context addons-543596 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:247: (dbg) Run:  kubectl --context addons-543596 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [f2f56289-9dbb-4ba7-bfe1-3c8c591ec472] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [f2f56289-9dbb-4ba7-bfe1-3c8c591ec472] Running
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 8.004341244s
addons_test.go:264: (dbg) Run:  out/minikube-linux-arm64 -p addons-543596 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:288: (dbg) Run:  kubectl --context addons-543596 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:293: (dbg) Run:  out/minikube-linux-arm64 -p addons-543596 ip
addons_test.go:299: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:308: (dbg) Run:  out/minikube-linux-arm64 -p addons-543596 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:308: (dbg) Done: out/minikube-linux-arm64 -p addons-543596 addons disable ingress-dns --alsologtostderr -v=1: (2.679618231s)
addons_test.go:313: (dbg) Run:  out/minikube-linux-arm64 -p addons-543596 addons disable ingress --alsologtostderr -v=1
addons_test.go:313: (dbg) Done: out/minikube-linux-arm64 -p addons-543596 addons disable ingress --alsologtostderr -v=1: (7.828931075s)
--- PASS: TestAddons/parallel/Ingress (20.42s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.81s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:840: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-plfhm" [14d8d522-a6bc-4cc0-9507-f9e32ba11ed9] Running / Ready:ContainersNotReady (containers with unready status: [gadget]) / ContainersReady:ContainersNotReady (containers with unready status: [gadget])
addons_test.go:840: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.00431816s
addons_test.go:843: (dbg) Run:  out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-543596
addons_test.go:843: (dbg) Done: out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-543596: (5.804823403s)
--- PASS: TestAddons/parallel/InspektorGadget (10.81s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.8s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:409: metrics-server stabilized in 3.471584ms
addons_test.go:411: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-c59844bb4-xrjr6" [a77dc4a4-a9d1-401c-a1ed-e0789e33726e] Running
addons_test.go:411: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.004721599s
addons_test.go:417: (dbg) Run:  kubectl --context addons-543596 top pods -n kube-system
addons_test.go:434: (dbg) Run:  out/minikube-linux-arm64 -p addons-543596 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.80s)

                                                
                                    
x
+
TestAddons/parallel/CSI (63.36s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:563: csi-hostpath-driver pods stabilized in 5.802919ms
addons_test.go:566: (dbg) Run:  kubectl --context addons-543596 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:571: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:576: (dbg) Run:  kubectl --context addons-543596 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:581: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [8053e4b2-f0b7-4f56-bd85-47c37d2ea951] Pending
helpers_test.go:344: "task-pv-pod" [8053e4b2-f0b7-4f56-bd85-47c37d2ea951] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [8053e4b2-f0b7-4f56-bd85-47c37d2ea951] Running
addons_test.go:581: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 11.003495604s
addons_test.go:586: (dbg) Run:  kubectl --context addons-543596 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:591: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-543596 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-543596 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:596: (dbg) Run:  kubectl --context addons-543596 delete pod task-pv-pod
addons_test.go:602: (dbg) Run:  kubectl --context addons-543596 delete pvc hpvc
addons_test.go:608: (dbg) Run:  kubectl --context addons-543596 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:613: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:618: (dbg) Run:  kubectl --context addons-543596 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:623: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [01582d5b-8f9d-4c4f-a5c9-299b7cf70159] Pending
helpers_test.go:344: "task-pv-pod-restore" [01582d5b-8f9d-4c4f-a5c9-299b7cf70159] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [01582d5b-8f9d-4c4f-a5c9-299b7cf70159] Running
addons_test.go:623: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 8.003634122s
addons_test.go:628: (dbg) Run:  kubectl --context addons-543596 delete pod task-pv-pod-restore
addons_test.go:628: (dbg) Done: kubectl --context addons-543596 delete pod task-pv-pod-restore: (1.17250621s)
addons_test.go:632: (dbg) Run:  kubectl --context addons-543596 delete pvc hpvc-restore
addons_test.go:636: (dbg) Run:  kubectl --context addons-543596 delete volumesnapshot new-snapshot-demo
addons_test.go:640: (dbg) Run:  out/minikube-linux-arm64 -p addons-543596 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:640: (dbg) Done: out/minikube-linux-arm64 -p addons-543596 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.743030029s)
addons_test.go:644: (dbg) Run:  out/minikube-linux-arm64 -p addons-543596 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (63.36s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (11.06s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:826: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-543596 --alsologtostderr -v=1
addons_test.go:826: (dbg) Done: out/minikube-linux-arm64 addons enable headlamp -p addons-543596 --alsologtostderr -v=1: (1.050484191s)
addons_test.go:831: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-7867546754-pqwhj" [ff62c4ce-89d9-41d8-9a1a-1619a82862c2] Pending
helpers_test.go:344: "headlamp-7867546754-pqwhj" [ff62c4ce-89d9-41d8-9a1a-1619a82862c2] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-7867546754-pqwhj" [ff62c4ce-89d9-41d8-9a1a-1619a82862c2] Running
addons_test.go:831: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 10.00394245s
--- PASS: TestAddons/parallel/Headlamp (11.06s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (6.67s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:859: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-6fcd4f6f98-jt67n" [69da83aa-ed93-40ff-a2dc-2ea55f9309a9] Running
addons_test.go:859: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 6.004002927s
addons_test.go:862: (dbg) Run:  out/minikube-linux-arm64 addons disable cloud-spanner -p addons-543596
--- PASS: TestAddons/parallel/CloudSpanner (6.67s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (51.64s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:974: (dbg) Run:  kubectl --context addons-543596 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:980: (dbg) Run:  kubectl --context addons-543596 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:984: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-543596 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:987: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [c8cd103a-8f9f-41bd-a4ca-2e860e6c10d0] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [c8cd103a-8f9f-41bd-a4ca-2e860e6c10d0] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [c8cd103a-8f9f-41bd-a4ca-2e860e6c10d0] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:987: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 3.003300147s
addons_test.go:992: (dbg) Run:  kubectl --context addons-543596 get pvc test-pvc -o=json
addons_test.go:1001: (dbg) Run:  out/minikube-linux-arm64 -p addons-543596 ssh "cat /opt/local-path-provisioner/pvc-a1739147-6404-4054-baf1-299e96a24f7f_default_test-pvc/file1"
addons_test.go:1013: (dbg) Run:  kubectl --context addons-543596 delete pod test-local-path
addons_test.go:1017: (dbg) Run:  kubectl --context addons-543596 delete pvc test-pvc
addons_test.go:1021: (dbg) Run:  out/minikube-linux-arm64 -p addons-543596 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:1021: (dbg) Done: out/minikube-linux-arm64 -p addons-543596 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (43.455984474s)
--- PASS: TestAddons/parallel/LocalPath (51.64s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (5.87s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:1053: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-xvxl5" [31b39b6e-f6d7-4e62-acb8-0f1e075da181] Running
addons_test.go:1053: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 5.005678865s
addons_test.go:1056: (dbg) Run:  out/minikube-linux-arm64 addons disable nvidia-device-plugin -p addons-543596
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (5.87s)

                                                
                                    
x
+
TestAddons/parallel/Yakd (6.01s)

                                                
                                                
=== RUN   TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Yakd
addons_test.go:1064: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:344: "yakd-dashboard-799879c74f-9rpm8" [940cec54-cd66-436c-9ebd-5a657aff478d] Running
addons_test.go:1064: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 6.0050062s
--- PASS: TestAddons/parallel/Yakd (6.01s)

                                                
                                    
x
+
TestAddons/parallel/Volcano (175.35s)

                                                
                                                
=== RUN   TestAddons/parallel/Volcano
=== PAUSE TestAddons/parallel/Volcano

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Volcano
addons_test.go:905: volcano-controller stabilized in 4.394607ms
addons_test.go:897: volcano-admission stabilized in 5.314257ms
addons_test.go:889: volcano-scheduler stabilized in 5.886937ms
addons_test.go:911: (dbg) TestAddons/parallel/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-844f6db89b-kmh69" [f2e4bf3c-567a-4fb6-8e58-30cb093912b9] Running
addons_test.go:911: (dbg) TestAddons/parallel/Volcano: app=volcano-scheduler healthy within 5.007823078s
addons_test.go:915: (dbg) TestAddons/parallel/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-5f7844f7bc-tghhc" [34037533-7821-4127-994b-898465f81454] Running
addons_test.go:915: (dbg) TestAddons/parallel/Volcano: app=volcano-admission healthy within 6.003912046s
addons_test.go:919: (dbg) TestAddons/parallel/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-59cb4746db-trbmd" [da2ca6d0-7ffa-4736-a409-2f11f5690742] Running
addons_test.go:919: (dbg) TestAddons/parallel/Volcano: app=volcano-controller healthy within 5.00483506s
addons_test.go:924: (dbg) Run:  kubectl --context addons-543596 delete -n volcano-system job volcano-admission-init
addons_test.go:930: (dbg) Run:  kubectl --context addons-543596 create -f testdata/vcjob.yaml
addons_test.go:938: (dbg) Run:  kubectl --context addons-543596 get vcjob -n my-volcano
addons_test.go:956: (dbg) TestAddons/parallel/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [18fbbc87-aa5b-44c0-afdc-26a11052a1cb] Pending
helpers_test.go:344: "test-job-nginx-0" [18fbbc87-aa5b-44c0-afdc-26a11052a1cb] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:344: "test-job-nginx-0" [18fbbc87-aa5b-44c0-afdc-26a11052a1cb] Pending: PodScheduled:Unschedulable (Pod my-volcano/test-job-nginx-0 can possibly be assigned to addons-543596, once resource is released)
helpers_test.go:344: "test-job-nginx-0" [18fbbc87-aa5b-44c0-afdc-26a11052a1cb] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "test-job-nginx-0" [18fbbc87-aa5b-44c0-afdc-26a11052a1cb] Running
addons_test.go:956: (dbg) TestAddons/parallel/Volcano: volcano.sh/job-name=test-job healthy within 2m28.003836171s
addons_test.go:960: (dbg) Run:  out/minikube-linux-arm64 -p addons-543596 addons disable volcano --alsologtostderr -v=1
addons_test.go:960: (dbg) Done: out/minikube-linux-arm64 -p addons-543596 addons disable volcano --alsologtostderr -v=1: (10.616192542s)
--- PASS: TestAddons/parallel/Volcano (175.35s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (2.35s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:652: (dbg) Run:  kubectl --context addons-543596 create ns new-namespace
addons_test.go:666: (dbg) Run:  kubectl --context addons-543596 get secret gcp-auth -n new-namespace
addons_test.go:666: (dbg) Non-zero exit: kubectl --context addons-543596 get secret gcp-auth -n new-namespace: exit status 1 (153.030718ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): secrets "gcp-auth" not found

                                                
                                                
** /stderr **
addons_test.go:658: (dbg) Run:  kubectl --context addons-543596 logs -l app=gcp-auth -n gcp-auth
addons_test.go:666: (dbg) Run:  kubectl --context addons-543596 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (2.35s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (12.27s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:174: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-543596
addons_test.go:174: (dbg) Done: out/minikube-linux-arm64 stop -p addons-543596: (12.009259912s)
addons_test.go:178: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-543596
addons_test.go:182: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-543596
addons_test.go:187: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-543596
--- PASS: TestAddons/StoppedEnableDisable (12.27s)

                                                
                                    
x
+
TestCertOptions (39.92s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-693725 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd
cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-693725 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd: (37.258246203s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-693725 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-693725 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-693725 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-693725" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-693725
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-693725: (1.995674247s)
--- PASS: TestCertOptions (39.92s)

                                                
                                    
x
+
TestCertExpiration (231.64s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-125673 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd
cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-125673 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd: (40.49354628s)
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-125673 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd
cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-125673 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd: (8.645592982s)
helpers_test.go:175: Cleaning up "cert-expiration-125673" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-125673
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-125673: (2.49794822s)
--- PASS: TestCertExpiration (231.64s)

                                                
                                    
x
+
TestForceSystemdFlag (41.71s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-853759 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
docker_test.go:91: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-853759 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (39.248803659s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-853759 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-flag-853759" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-853759
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-853759: (2.148091491s)
--- PASS: TestForceSystemdFlag (41.71s)

                                                
                                    
x
+
TestForceSystemdEnv (48.46s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-336096 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
docker_test.go:155: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-336096 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (45.897658558s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-env-336096 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-env-336096" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-336096
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-336096: (2.184759132s)
--- PASS: TestForceSystemdEnv (48.46s)

                                                
                                    
x
+
TestDockerEnvContainerd (44.46s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with containerd true linux arm64
docker_test.go:181: (dbg) Run:  out/minikube-linux-arm64 start -p dockerenv-600826 --driver=docker  --container-runtime=containerd
docker_test.go:181: (dbg) Done: out/minikube-linux-arm64 start -p dockerenv-600826 --driver=docker  --container-runtime=containerd: (28.210616018s)
docker_test.go:189: (dbg) Run:  /bin/bash -c "out/minikube-linux-arm64 docker-env --ssh-host --ssh-add -p dockerenv-600826"
docker_test.go:189: (dbg) Done: /bin/bash -c "out/minikube-linux-arm64 docker-env --ssh-host --ssh-add -p dockerenv-600826": (1.038146429s)
docker_test.go:220: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-9WxFos8eqAoL/agent.745077" SSH_AGENT_PID="745078" DOCKER_HOST=ssh://docker@127.0.0.1:33534 docker version"
docker_test.go:243: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-9WxFos8eqAoL/agent.745077" SSH_AGENT_PID="745078" DOCKER_HOST=ssh://docker@127.0.0.1:33534 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env"
docker_test.go:243: (dbg) Done: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-9WxFos8eqAoL/agent.745077" SSH_AGENT_PID="745078" DOCKER_HOST=ssh://docker@127.0.0.1:33534 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env": (1.343813668s)
docker_test.go:250: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-9WxFos8eqAoL/agent.745077" SSH_AGENT_PID="745078" DOCKER_HOST=ssh://docker@127.0.0.1:33534 docker image ls"
docker_test.go:250: (dbg) Done: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-9WxFos8eqAoL/agent.745077" SSH_AGENT_PID="745078" DOCKER_HOST=ssh://docker@127.0.0.1:33534 docker image ls": (1.139846993s)
helpers_test.go:175: Cleaning up "dockerenv-600826" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p dockerenv-600826
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p dockerenv-600826: (2.086332529s)
--- PASS: TestDockerEnvContainerd (44.46s)

                                                
                                    
x
+
TestErrorSpam/setup (29.21s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-078354 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-078354 --driver=docker  --container-runtime=containerd
error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-078354 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-078354 --driver=docker  --container-runtime=containerd: (29.213977622s)
--- PASS: TestErrorSpam/setup (29.21s)

                                                
                                    
x
+
TestErrorSpam/start (0.73s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 start --dry-run
--- PASS: TestErrorSpam/start (0.73s)

                                                
                                    
x
+
TestErrorSpam/status (0.97s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 status
E0717 19:43:15.879401  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
E0717 19:43:15.886382  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
E0717 19:43:15.896725  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
E0717 19:43:15.916973  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
E0717 19:43:15.957915  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
E0717 19:43:16.038236  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 status
E0717 19:43:16.199072  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 status
E0717 19:43:16.519458  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
--- PASS: TestErrorSpam/status (0.97s)

                                                
                                    
x
+
TestErrorSpam/pause (1.65s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 pause
E0717 19:43:17.159978  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 pause
E0717 19:43:18.440849  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
--- PASS: TestErrorSpam/pause (1.65s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.85s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 unpause
--- PASS: TestErrorSpam/unpause (1.85s)

                                                
                                    
x
+
TestErrorSpam/stop (1.4s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 stop
E0717 19:43:21.001923  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 stop: (1.202450808s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-078354 --log_dir /tmp/nospam-078354 stop
--- PASS: TestErrorSpam/stop (1.40s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /home/jenkins/minikube-integration/19282-720845/.minikube/files/etc/test/nested/copy/726225/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (61.9s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-linux-arm64 start -p functional-940017 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd
E0717 19:43:36.362862  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
E0717 19:43:56.843034  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
functional_test.go:2230: (dbg) Done: out/minikube-linux-arm64 start -p functional-940017 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd: (1m1.898718504s)
--- PASS: TestFunctional/serial/StartWithProxy (61.90s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (6.32s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-linux-arm64 start -p functional-940017 --alsologtostderr -v=8
functional_test.go:655: (dbg) Done: out/minikube-linux-arm64 start -p functional-940017 --alsologtostderr -v=8: (6.312358424s)
functional_test.go:659: soft start took 6.314894239s for "functional-940017" cluster.
--- PASS: TestFunctional/serial/SoftStart (6.32s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.06s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-940017 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (4.63s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-940017 cache add registry.k8s.io/pause:3.1: (1.722214517s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 cache add registry.k8s.io/pause:3.3
E0717 19:44:37.804029  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-940017 cache add registry.k8s.io/pause:3.3: (1.511392215s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 cache add registry.k8s.io/pause:latest
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-940017 cache add registry.k8s.io/pause:latest: (1.395139272s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (4.63s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.42s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-940017 /tmp/TestFunctionalserialCacheCmdcacheadd_local3325864593/001
functional_test.go:1085: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 cache add minikube-local-cache-test:functional-940017
functional_test.go:1090: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 cache delete minikube-local-cache-test:functional-940017
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-940017
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.42s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-linux-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.31s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.31s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (2.2s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh sudo crictl rmi registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-940017 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (294.304363ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1154: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 cache reload
functional_test.go:1154: (dbg) Done: out/minikube-linux-arm64 -p functional-940017 cache reload: (1.252174545s)
functional_test.go:1159: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (2.20s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.11s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.13s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 kubectl -- --context functional-940017 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.13s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.13s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-940017 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.13s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (72.19s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-linux-arm64 start -p functional-940017 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:753: (dbg) Done: out/minikube-linux-arm64 start -p functional-940017 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (1m12.185124003s)
functional_test.go:757: restart took 1m12.185242786s for "functional-940017" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (72.19s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-940017 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:821: etcd phase: Running
functional_test.go:831: etcd status: Ready
functional_test.go:821: kube-apiserver phase: Running
functional_test.go:831: kube-apiserver status: Ready
functional_test.go:821: kube-controller-manager phase: Running
functional_test.go:831: kube-controller-manager status: Ready
functional_test.go:821: kube-scheduler phase: Running
functional_test.go:831: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.09s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.73s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 logs
functional_test.go:1232: (dbg) Done: out/minikube-linux-arm64 -p functional-940017 logs: (1.733259668s)
--- PASS: TestFunctional/serial/LogsCmd (1.73s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.94s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 logs --file /tmp/TestFunctionalserialLogsFileCmd3027329468/001/logs.txt
E0717 19:45:59.724670  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
functional_test.go:1246: (dbg) Done: out/minikube-linux-arm64 -p functional-940017 logs --file /tmp/TestFunctionalserialLogsFileCmd3027329468/001/logs.txt: (1.939051598s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.94s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.11s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-940017 apply -f testdata/invalidsvc.yaml
functional_test.go:2331: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-940017
functional_test.go:2331: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-940017: exit status 115 (437.618532ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:30845 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2323: (dbg) Run:  kubectl --context functional-940017 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (4.11s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-940017 config get cpus: exit status 14 (78.872464ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-940017 config get cpus: exit status 14 (94.188983ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (10.96s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-940017 --alsologtostderr -v=1]
functional_test.go:906: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-940017 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 760370: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (10.96s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.46s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-linux-arm64 start -p functional-940017 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:970: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-940017 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (181.620468ms)

                                                
                                                
-- stdout --
	* [functional-940017] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19282
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 19:46:36.354760  760066 out.go:291] Setting OutFile to fd 1 ...
	I0717 19:46:36.354961  760066 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 19:46:36.355004  760066 out.go:304] Setting ErrFile to fd 2...
	I0717 19:46:36.355030  760066 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 19:46:36.355287  760066 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
	I0717 19:46:36.355693  760066 out.go:298] Setting JSON to false
	I0717 19:46:36.356869  760066 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":12544,"bootTime":1721233052,"procs":215,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0717 19:46:36.356972  760066 start.go:139] virtualization:  
	I0717 19:46:36.359517  760066 out.go:177] * [functional-940017] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0717 19:46:36.362015  760066 out.go:177]   - MINIKUBE_LOCATION=19282
	I0717 19:46:36.362088  760066 notify.go:220] Checking for updates...
	I0717 19:46:36.366417  760066 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 19:46:36.368600  760066 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig
	I0717 19:46:36.370776  760066 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube
	I0717 19:46:36.372766  760066 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0717 19:46:36.374722  760066 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0717 19:46:36.377046  760066 config.go:182] Loaded profile config "functional-940017": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
	I0717 19:46:36.377661  760066 driver.go:392] Setting default libvirt URI to qemu:///system
	I0717 19:46:36.401629  760066 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0717 19:46:36.401741  760066 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 19:46:36.459412  760066 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:52 SystemTime:2024-07-17 19:46:36.449463164 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0717 19:46:36.459526  760066 docker.go:307] overlay module found
	I0717 19:46:36.461649  760066 out.go:177] * Using the docker driver based on existing profile
	I0717 19:46:36.463683  760066 start.go:297] selected driver: docker
	I0717 19:46:36.463729  760066 start.go:901] validating driver "docker" against &{Name:functional-940017 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:functional-940017 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.30.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0717 19:46:36.463848  760066 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0717 19:46:36.466227  760066 out.go:177] 
	W0717 19:46:36.468246  760066 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0717 19:46:36.470347  760066 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-linux-arm64 start -p functional-940017 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
--- PASS: TestFunctional/parallel/DryRun (0.46s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-linux-arm64 start -p functional-940017 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-940017 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (225.115369ms)

                                                
                                                
-- stdout --
	* [functional-940017] minikube v1.33.1 sur Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19282
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 19:46:36.144896  759961 out.go:291] Setting OutFile to fd 1 ...
	I0717 19:46:36.145122  759961 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 19:46:36.145149  759961 out.go:304] Setting ErrFile to fd 2...
	I0717 19:46:36.145182  759961 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 19:46:36.145560  759961 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
	I0717 19:46:36.145997  759961 out.go:298] Setting JSON to false
	I0717 19:46:36.147169  759961 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":12544,"bootTime":1721233052,"procs":215,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0717 19:46:36.147277  759961 start.go:139] virtualization:  
	I0717 19:46:36.150061  759961 out.go:177] * [functional-940017] minikube v1.33.1 sur Ubuntu 20.04 (arm64)
	I0717 19:46:36.152392  759961 notify.go:220] Checking for updates...
	I0717 19:46:36.154254  759961 out.go:177]   - MINIKUBE_LOCATION=19282
	I0717 19:46:36.156147  759961 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 19:46:36.157968  759961 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig
	I0717 19:46:36.160103  759961 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube
	I0717 19:46:36.162161  759961 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0717 19:46:36.163899  759961 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0717 19:46:36.166330  759961 config.go:182] Loaded profile config "functional-940017": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
	I0717 19:46:36.166882  759961 driver.go:392] Setting default libvirt URI to qemu:///system
	I0717 19:46:36.212316  759961 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0717 19:46:36.212440  759961 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 19:46:36.288205  759961 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:52 SystemTime:2024-07-17 19:46:36.275697651 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0717 19:46:36.288316  759961 docker.go:307] overlay module found
	I0717 19:46:36.290313  759961 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0717 19:46:36.292207  759961 start.go:297] selected driver: docker
	I0717 19:46:36.292234  759961 start.go:901] validating driver "docker" against &{Name:functional-940017 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1721234491-19282@sha256:af477ffa9f6167a73f0adae71d3a4e601ba0c2adc97a4067255b422b3477d2c2 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:functional-940017 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.30.2 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0717 19:46:36.292360  759961 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0717 19:46:36.294700  759961 out.go:177] 
	W0717 19:46:36.296686  759961 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0717 19:46:36.298921  759961 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (1.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 status
functional_test.go:856: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:868: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.25s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (9.64s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1623: (dbg) Run:  kubectl --context functional-940017 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1631: (dbg) Run:  kubectl --context functional-940017 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1636: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-6f49f58cd5-5vgvx" [47779ede-a6ca-4954-a7c8-7b9f5df57d6c] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-connect-6f49f58cd5-5vgvx" [47779ede-a6ca-4954-a7c8-7b9f5df57d6c] Running
functional_test.go:1636: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 9.004193803s
functional_test.go:1645: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 service hello-node-connect --url
functional_test.go:1651: found endpoint for hello-node-connect: http://192.168.49.2:32526
functional_test.go:1671: http://192.168.49.2:32526: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-6f49f58cd5-5vgvx

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:32526
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (9.64s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1686: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 addons list
functional_test.go:1698: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (25.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [f38705f6-a5dc-4e56-9248-5907607a1714] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 6.004701525s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-940017 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-940017 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-940017 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-940017 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [3b51470f-b88c-47fa-80b0-949eb36f472b] Pending
helpers_test.go:344: "sp-pod" [3b51470f-b88c-47fa-80b0-949eb36f472b] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [3b51470f-b88c-47fa-80b0-949eb36f472b] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 10.004987362s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-940017 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-940017 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:106: (dbg) Done: kubectl --context functional-940017 delete -f testdata/storage-provisioner/pod.yaml: (1.147946019s)
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-940017 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [840fa41b-acd5-4277-a5f5-d1e392834285] Pending
helpers_test.go:344: "sp-pod" [840fa41b-acd5-4277-a5f5-d1e392834285] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 7.003467833s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-940017 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (25.12s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.64s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1721: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "echo hello"
functional_test.go:1738: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.64s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (2.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh -n functional-940017 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 cp functional-940017:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd4266590836/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh -n functional-940017 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh -n functional-940017 "sudo cat /tmp/does/not/exist/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (2.26s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/726225/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "sudo cat /etc/test/nested/copy/726225/hosts"
functional_test.go:1932: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (2.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/726225.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "sudo cat /etc/ssl/certs/726225.pem"
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/726225.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "sudo cat /usr/share/ca-certificates/726225.pem"
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/7262252.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "sudo cat /etc/ssl/certs/7262252.pem"
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/7262252.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "sudo cat /usr/share/ca-certificates/7262252.pem"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (2.26s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-940017 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.59s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "sudo systemctl is-active docker"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-940017 ssh "sudo systemctl is-active docker": exit status 1 (317.388869ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-940017 ssh "sudo systemctl is-active crio": exit status 1 (276.235407ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.59s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-linux-arm64 license
--- PASS: TestFunctional/parallel/License (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.67s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-940017 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-940017 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-940017 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-940017 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 757519: os: process already finished
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.67s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-arm64 -p functional-940017 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (9.43s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-940017 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [f781ccfc-b569-48e2-8845-c01d15d72581] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [f781ccfc-b569-48e2-8845-c01d15d72581] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 9.003754885s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (9.43s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-940017 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.108.104.143 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-arm64 -p functional-940017 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (6.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1433: (dbg) Run:  kubectl --context functional-940017 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1441: (dbg) Run:  kubectl --context functional-940017 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1446: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-65f5d5cc78-qdwk7" [2899a2cb-758b-47c2-8f41-35666d89750d] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-65f5d5cc78-qdwk7" [2899a2cb-758b-47c2-8f41-35666d89750d] Running
functional_test.go:1446: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 6.004118736s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (6.23s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1266: (dbg) Run:  out/minikube-linux-arm64 profile lis
functional_test.go:1271: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.51s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.62s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1455: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.62s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1306: (dbg) Run:  out/minikube-linux-arm64 profile list
functional_test.go:1311: Took "368.944172ms" to run "out/minikube-linux-arm64 profile list"
functional_test.go:1320: (dbg) Run:  out/minikube-linux-arm64 profile list -l
functional_test.go:1325: Took "102.577151ms" to run "out/minikube-linux-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.65s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1485: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 service list -o json
functional_test.go:1490: Took "648.481266ms" to run "out/minikube-linux-arm64 -p functional-940017 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.65s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.49s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1357: (dbg) Run:  out/minikube-linux-arm64 profile list -o json
functional_test.go:1362: Took "411.779414ms" to run "out/minikube-linux-arm64 profile list -o json"
functional_test.go:1370: (dbg) Run:  out/minikube-linux-arm64 profile list -o json --light
functional_test.go:1375: Took "78.50218ms" to run "out/minikube-linux-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.49s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1505: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 service --namespace=default --https --url hello-node
functional_test.go:1518: found endpoint: https://192.168.49.2:30382
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.51s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (7.44s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-940017 /tmp/TestFunctionalparallelMountCmdany-port1996488233/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1721245593556731590" to /tmp/TestFunctionalparallelMountCmdany-port1996488233/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1721245593556731590" to /tmp/TestFunctionalparallelMountCmdany-port1996488233/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1721245593556731590" to /tmp/TestFunctionalparallelMountCmdany-port1996488233/001/test-1721245593556731590
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-940017 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (507.355888ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Jul 17 19:46 created-by-test
-rw-r--r-- 1 docker docker 24 Jul 17 19:46 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Jul 17 19:46 test-1721245593556731590
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh cat /mount-9p/test-1721245593556731590
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-940017 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [2646e44e-6f8d-41bb-89a9-0c3a607b1b7f] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [2646e44e-6f8d-41bb-89a9-0c3a607b1b7f] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [2646e44e-6f8d-41bb-89a9-0c3a607b1b7f] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.004585222s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-940017 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-940017 /tmp/TestFunctionalparallelMountCmdany-port1996488233/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (7.44s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1536: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.41s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.43s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1555: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 service hello-node --url
functional_test.go:1561: found endpoint for hello-node: http://192.168.49.2:30382
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.43s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (2.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-940017 /tmp/TestFunctionalparallelMountCmdspecific-port428674027/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-940017 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (381.316245ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-940017 /tmp/TestFunctionalparallelMountCmdspecific-port428674027/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-940017 ssh "sudo umount -f /mount-9p": exit status 1 (315.552899ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-940017 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-940017 /tmp/TestFunctionalparallelMountCmdspecific-port428674027/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.20s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (2.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-940017 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2779293288/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-940017 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2779293288/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-940017 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2779293288/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-940017 ssh "findmnt -T" /mount1: exit status 1 (698.423651ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-arm64 mount -p functional-940017 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-940017 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2779293288/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-940017 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2779293288/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-940017 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2779293288/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (2.45s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 version --short
--- PASS: TestFunctional/parallel/Version/short (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (1.35s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 version -o=json --components
functional_test.go:2266: (dbg) Done: out/minikube-linux-arm64 -p functional-940017 version -o=json --components: (1.354221382s)
--- PASS: TestFunctional/parallel/Version/components (1.35s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.29s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-940017 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.30.2
registry.k8s.io/kube-proxy:v1.30.2
registry.k8s.io/kube-controller-manager:v1.30.2
registry.k8s.io/kube-apiserver:v1.30.2
registry.k8s.io/etcd:3.5.12-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.11.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/minikube-local-cache-test:functional-940017
docker.io/kindest/kindnetd:v20240715-585640e9
docker.io/kindest/kindnetd:v20240513-cd2ac642
docker.io/kicbase/echo-server:functional-940017
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-940017 image ls --format short --alsologtostderr:
I0717 19:46:54.960600  762872 out.go:291] Setting OutFile to fd 1 ...
I0717 19:46:54.960870  762872 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 19:46:54.960884  762872 out.go:304] Setting ErrFile to fd 2...
I0717 19:46:54.960890  762872 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 19:46:54.961209  762872 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
I0717 19:46:54.962010  762872 config.go:182] Loaded profile config "functional-940017": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
I0717 19:46:54.962214  762872 config.go:182] Loaded profile config "functional-940017": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
I0717 19:46:54.962813  762872 cli_runner.go:164] Run: docker container inspect functional-940017 --format={{.State.Status}}
I0717 19:46:54.980447  762872 ssh_runner.go:195] Run: systemctl --version
I0717 19:46:54.980517  762872 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-940017
I0717 19:46:55.020411  762872 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33544 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/functional-940017/id_rsa Username:docker}
I0717 19:46:55.108927  762872 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.29s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-940017 image ls --format table --alsologtostderr:
|---------------------------------------------|--------------------|---------------|--------|
|                    Image                    |        Tag         |   Image ID    |  Size  |
|---------------------------------------------|--------------------|---------------|--------|
| registry.k8s.io/kube-apiserver              | v1.30.2            | sha256:84c601 | 29.9MB |
| registry.k8s.io/kube-controller-manager     | v1.30.2            | sha256:e1dcc3 | 28.4MB |
| registry.k8s.io/pause                       | 3.9                | sha256:829e9d | 268kB  |
| docker.io/library/minikube-local-cache-test | functional-940017  | sha256:7d5d97 | 992B   |
| registry.k8s.io/pause                       | 3.1                | sha256:8057e0 | 262kB  |
| registry.k8s.io/pause                       | 3.3                | sha256:3d1873 | 249kB  |
| registry.k8s.io/coredns/coredns             | v1.11.1            | sha256:2437cf | 16.5MB |
| registry.k8s.io/kube-scheduler              | v1.30.2            | sha256:c7dd04 | 17.6MB |
| registry.k8s.io/etcd                        | 3.5.12-0           | sha256:014faa | 66.2MB |
| docker.io/kindest/kindnetd                  | v20240513-cd2ac642 | sha256:89d73d | 25.8MB |
| registry.k8s.io/pause                       | latest             | sha256:8cb209 | 71.3kB |
| docker.io/library/nginx                     | latest             | sha256:443d19 | 67.6MB |
| gcr.io/k8s-minikube/storage-provisioner     | v5                 | sha256:ba04bb | 8.03MB |
| docker.io/kindest/kindnetd                  | v20240715-585640e9 | sha256:5e3296 | 33.3MB |
| docker.io/kicbase/echo-server               | functional-940017  | sha256:ce2d2c | 2.17MB |
| docker.io/library/nginx                     | alpine             | sha256:5461b1 | 18.3MB |
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc       | sha256:1611cd | 1.94MB |
| registry.k8s.io/echoserver-arm              | 1.8                | sha256:72565b | 45.3MB |
| registry.k8s.io/kube-proxy                  | v1.30.2            | sha256:66dbb9 | 25.6MB |
|---------------------------------------------|--------------------|---------------|--------|
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-940017 image ls --format table --alsologtostderr:
I0717 19:46:55.550043  763022 out.go:291] Setting OutFile to fd 1 ...
I0717 19:46:55.550221  763022 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 19:46:55.550227  763022 out.go:304] Setting ErrFile to fd 2...
I0717 19:46:55.550232  763022 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 19:46:55.550462  763022 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
I0717 19:46:55.551068  763022 config.go:182] Loaded profile config "functional-940017": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
I0717 19:46:55.551186  763022 config.go:182] Loaded profile config "functional-940017": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
I0717 19:46:55.551653  763022 cli_runner.go:164] Run: docker container inspect functional-940017 --format={{.State.Status}}
I0717 19:46:55.574218  763022 ssh_runner.go:195] Run: systemctl --version
I0717 19:46:55.574282  763022 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-940017
I0717 19:46:55.599226  763022 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33544 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/functional-940017/id_rsa Username:docker}
I0717 19:46:55.685279  763022 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-940017 image ls --format json --alsologtostderr:
[{"id":"sha256:e1dcc3400d3ea6a268c7ea6e66c3a196703770a8e346b695f54344ab53a47567","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:4c412bc1fc585ddeba10d34a02e7507ea787ec2c57256d4c18fd230377ab048e"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.30.2"],"size":"28368865"},{"id":"sha256:66dbb96a9149f69913ff817f696be766014cacdffc2ce0889a76c81165415fae","repoDigests":["registry.k8s.io/kube-proxy@sha256:8a44c6e094af3dea3de57fa967e201608a358a3bd8b4e3f31ab905bbe4108aec"],"repoTags":["registry.k8s.io/kube-proxy:v1.30.2"],"size":"25633111"},{"id":"sha256:3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"249461"},{"id":"sha256:a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a","repoDigests":["docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"],"repoTags":[],"size":"18306114"},{"id":"sha256:5461b18aaccf366faf9fba071a5f1ac333cd13435366b3
2c5e9b8ec903fa18a1","repoDigests":["docker.io/library/nginx@sha256:a45ee5d042aaa9e81e013f97ae40c3dda26fbe98f22b6251acdf28e579560d55"],"repoTags":["docker.io/library/nginx:alpine"],"size":"18252263"},{"id":"sha256:443d199e8bfcce69c2aa494b36b5f8b04c3b183277cd19190e9589fd8552d618","repoDigests":["docker.io/library/nginx@sha256:67682bda769fae1ccf5183192b8daf37b64cae99c6c3302650f6f8bf5f0f95df"],"repoTags":["docker.io/library/nginx:latest"],"size":"67646985"},{"id":"sha256:014faa467e29798aeef733fe6d1a3b5e382688217b053ad23410e6cccd5d22fd","repoDigests":["registry.k8s.io/etcd@sha256:44a8e24dcbba3470ee1fee21d5e88d128c936e9b55d4bc51fbef8086f8ed123b"],"repoTags":["registry.k8s.io/etcd:3.5.12-0"],"size":"66189079"},{"id":"sha256:84c601f3f72c87776cdcf77a73329d1f45297e43a92508b0f289fa2fcf8872a0","repoDigests":["registry.k8s.io/kube-apiserver@sha256:340ab4a1d66a60630a7a298aa0b2576fcd82e51ecdddb751cf61e5d3846fde2d"],"repoTags":["registry.k8s.io/kube-apiserver:v1.30.2"],"size":"29937230"},{"id":"sha256:829e9de338bd5fdd3f16f68
f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e","repoDigests":["registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097"],"repoTags":["registry.k8s.io/pause:3.9"],"size":"268051"},{"id":"sha256:5e32961ddcea3ade65511b2e27f675bbda25305639279f8b708014019e8cebb2","repoDigests":["docker.io/kindest/kindnetd@sha256:88ed2adbc140254762f98fad7f4b16d279117356ebaf95aebf191713c828a493"],"repoTags":["docker.io/kindest/kindnetd:v20240715-585640e9"],"size":"33290438"},{"id":"sha256:ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17","repoDigests":[],"repoTags":["docker.io/kicbase/echo-server:functional-940017"],"size":"2173567"},{"id":"sha256:ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"8034419"},{"id":"sha256:c7dd04b1bafeb51c650fde7f34ac0fdafa96030e77ea7a822135ff30
2d895dd5","repoDigests":["registry.k8s.io/kube-scheduler@sha256:0ed75a333704f5d315395c6ec04d7af7405715537069b65d40b43ec1c8e030bc"],"repoTags":["registry.k8s.io/kube-scheduler:v1.30.2"],"size":"17643200"},{"id":"sha256:89d73d416b992e8f9602b67b4614d9e7f0655aebb3696e18efec695e0b654c40","repoDigests":["docker.io/kindest/kindnetd@sha256:9c2b5fcda3cb5a9725ecb893f3c8998a92d51a87465a886eb563e18d649383a8"],"repoTags":["docker.io/kindest/kindnetd:v20240513-cd2ac642"],"size":"25795292"},{"id":"sha256:20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8","repoDigests":["docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93"],"repoTags":[],"size":"74084559"},{"id":"sha256:8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"71300"},{"id":"sha256:1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061d
d110530b0ece7998cd84121f952adef120ea7c5a6f00e"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"1935750"},{"id":"sha256:2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93","repoDigests":["registry.k8s.io/coredns/coredns@sha256:1eeb4c7316bacb1d4c8ead65571cd92dd21e27359f0d4917f1a5822a73b75db1"],"repoTags":["registry.k8s.io/coredns/coredns:v1.11.1"],"size":"16482581"},{"id":"sha256:72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":["registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5"],"repoTags":["registry.k8s.io/echoserver-arm:1.8"],"size":"45324675"},{"id":"sha256:7d5d971f81db9d58fd8a8c4d3cc2f0c2e7331b12e580e4e3d3421f6c5923fbf0","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-940017"],"size":"992"},{"id":"sha256:8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"262191"}]
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-940017 image ls --format json --alsologtostderr:
I0717 19:46:55.269642  762937 out.go:291] Setting OutFile to fd 1 ...
I0717 19:46:55.269848  762937 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 19:46:55.269860  762937 out.go:304] Setting ErrFile to fd 2...
I0717 19:46:55.269865  762937 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 19:46:55.270118  762937 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
I0717 19:46:55.270795  762937 config.go:182] Loaded profile config "functional-940017": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
I0717 19:46:55.270915  762937 config.go:182] Loaded profile config "functional-940017": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
I0717 19:46:55.271421  762937 cli_runner.go:164] Run: docker container inspect functional-940017 --format={{.State.Status}}
I0717 19:46:55.301780  762937 ssh_runner.go:195] Run: systemctl --version
I0717 19:46:55.301840  762937 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-940017
I0717 19:46:55.327169  762937 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33544 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/functional-940017/id_rsa Username:docker}
I0717 19:46:55.431083  762937 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.30s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-940017 image ls --format yaml --alsologtostderr:
- id: sha256:829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e
repoDigests:
- registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097
repoTags:
- registry.k8s.io/pause:3.9
size: "268051"
- id: sha256:89d73d416b992e8f9602b67b4614d9e7f0655aebb3696e18efec695e0b654c40
repoDigests:
- docker.io/kindest/kindnetd@sha256:9c2b5fcda3cb5a9725ecb893f3c8998a92d51a87465a886eb563e18d649383a8
repoTags:
- docker.io/kindest/kindnetd:v20240513-cd2ac642
size: "25795292"
- id: sha256:84c601f3f72c87776cdcf77a73329d1f45297e43a92508b0f289fa2fcf8872a0
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:340ab4a1d66a60630a7a298aa0b2576fcd82e51ecdddb751cf61e5d3846fde2d
repoTags:
- registry.k8s.io/kube-apiserver:v1.30.2
size: "29937230"
- id: sha256:ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "8034419"
- id: sha256:e1dcc3400d3ea6a268c7ea6e66c3a196703770a8e346b695f54344ab53a47567
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:4c412bc1fc585ddeba10d34a02e7507ea787ec2c57256d4c18fd230377ab048e
repoTags:
- registry.k8s.io/kube-controller-manager:v1.30.2
size: "28368865"
- id: sha256:3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "249461"
- id: sha256:ce2d2cda2d858fdaea84129deb86d18e5dbf1c548f230b79fdca74cc91729d17
repoDigests: []
repoTags:
- docker.io/kicbase/echo-server:functional-940017
size: "2173567"
- id: sha256:a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a
repoDigests:
- docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c
repoTags: []
size: "18306114"
- id: sha256:66dbb96a9149f69913ff817f696be766014cacdffc2ce0889a76c81165415fae
repoDigests:
- registry.k8s.io/kube-proxy@sha256:8a44c6e094af3dea3de57fa967e201608a358a3bd8b4e3f31ab905bbe4108aec
repoTags:
- registry.k8s.io/kube-proxy:v1.30.2
size: "25633111"
- id: sha256:8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "262191"
- id: sha256:8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "71300"
- id: sha256:1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "1935750"
- id: sha256:72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests:
- registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "45324675"
- id: sha256:7d5d971f81db9d58fd8a8c4d3cc2f0c2e7331b12e580e4e3d3421f6c5923fbf0
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-940017
size: "992"
- id: sha256:5461b18aaccf366faf9fba071a5f1ac333cd13435366b32c5e9b8ec903fa18a1
repoDigests:
- docker.io/library/nginx@sha256:a45ee5d042aaa9e81e013f97ae40c3dda26fbe98f22b6251acdf28e579560d55
repoTags:
- docker.io/library/nginx:alpine
size: "18252263"
- id: sha256:443d199e8bfcce69c2aa494b36b5f8b04c3b183277cd19190e9589fd8552d618
repoDigests:
- docker.io/library/nginx@sha256:67682bda769fae1ccf5183192b8daf37b64cae99c6c3302650f6f8bf5f0f95df
repoTags:
- docker.io/library/nginx:latest
size: "67646985"
- id: sha256:2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:1eeb4c7316bacb1d4c8ead65571cd92dd21e27359f0d4917f1a5822a73b75db1
repoTags:
- registry.k8s.io/coredns/coredns:v1.11.1
size: "16482581"
- id: sha256:014faa467e29798aeef733fe6d1a3b5e382688217b053ad23410e6cccd5d22fd
repoDigests:
- registry.k8s.io/etcd@sha256:44a8e24dcbba3470ee1fee21d5e88d128c936e9b55d4bc51fbef8086f8ed123b
repoTags:
- registry.k8s.io/etcd:3.5.12-0
size: "66189079"
- id: sha256:c7dd04b1bafeb51c650fde7f34ac0fdafa96030e77ea7a822135ff302d895dd5
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:0ed75a333704f5d315395c6ec04d7af7405715537069b65d40b43ec1c8e030bc
repoTags:
- registry.k8s.io/kube-scheduler:v1.30.2
size: "17643200"
- id: sha256:20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8
repoDigests:
- docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93
repoTags: []
size: "74084559"
- id: sha256:5e32961ddcea3ade65511b2e27f675bbda25305639279f8b708014019e8cebb2
repoDigests:
- docker.io/kindest/kindnetd@sha256:88ed2adbc140254762f98fad7f4b16d279117356ebaf95aebf191713c828a493
repoTags:
- docker.io/kindest/kindnetd:v20240715-585640e9
size: "33290438"

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-940017 image ls --format yaml --alsologtostderr:
I0717 19:46:54.961436  762873 out.go:291] Setting OutFile to fd 1 ...
I0717 19:46:54.961617  762873 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 19:46:54.961648  762873 out.go:304] Setting ErrFile to fd 2...
I0717 19:46:54.961669  762873 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 19:46:54.961934  762873 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
I0717 19:46:54.962686  762873 config.go:182] Loaded profile config "functional-940017": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
I0717 19:46:54.962870  762873 config.go:182] Loaded profile config "functional-940017": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
I0717 19:46:54.963434  762873 cli_runner.go:164] Run: docker container inspect functional-940017 --format={{.State.Status}}
I0717 19:46:54.988702  762873 ssh_runner.go:195] Run: systemctl --version
I0717 19:46:54.988841  762873 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-940017
I0717 19:46:55.016308  762873 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33544 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/functional-940017/id_rsa Username:docker}
I0717 19:46:55.117473  762873 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (2.98s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-940017 ssh pgrep buildkitd: exit status 1 (358.881589ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image build -t localhost/my-image:functional-940017 testdata/build --alsologtostderr
functional_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p functional-940017 image build -t localhost/my-image:functional-940017 testdata/build --alsologtostderr: (2.375697834s)
functional_test.go:322: (dbg) Stderr: out/minikube-linux-arm64 -p functional-940017 image build -t localhost/my-image:functional-940017 testdata/build --alsologtostderr:
I0717 19:46:55.614811  763028 out.go:291] Setting OutFile to fd 1 ...
I0717 19:46:55.615585  763028 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 19:46:55.615619  763028 out.go:304] Setting ErrFile to fd 2...
I0717 19:46:55.615640  763028 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0717 19:46:55.615925  763028 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
I0717 19:46:55.616703  763028 config.go:182] Loaded profile config "functional-940017": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
I0717 19:46:55.618554  763028 config.go:182] Loaded profile config "functional-940017": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
I0717 19:46:55.619366  763028 cli_runner.go:164] Run: docker container inspect functional-940017 --format={{.State.Status}}
I0717 19:46:55.640663  763028 ssh_runner.go:195] Run: systemctl --version
I0717 19:46:55.640716  763028 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-940017
I0717 19:46:55.659446  763028 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33544 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/functional-940017/id_rsa Username:docker}
I0717 19:46:55.750173  763028 build_images.go:161] Building image from path: /tmp/build.532129478.tar
I0717 19:46:55.750250  763028 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0717 19:46:55.760378  763028 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.532129478.tar
I0717 19:46:55.764122  763028 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.532129478.tar: stat -c "%s %y" /var/lib/minikube/build/build.532129478.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.532129478.tar': No such file or directory
I0717 19:46:55.764153  763028 ssh_runner.go:362] scp /tmp/build.532129478.tar --> /var/lib/minikube/build/build.532129478.tar (3072 bytes)
I0717 19:46:55.792513  763028 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.532129478
I0717 19:46:55.802062  763028 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.532129478 -xf /var/lib/minikube/build/build.532129478.tar
I0717 19:46:55.811872  763028 containerd.go:394] Building image: /var/lib/minikube/build/build.532129478
I0717 19:46:55.812008  763028 ssh_runner.go:195] Run: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.532129478 --local dockerfile=/var/lib/minikube/build/build.532129478 --output type=image,name=localhost/my-image:functional-940017
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 97B done
#1 DONE 0.0s

                                                
                                                
#2 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#2 DONE 0.7s

                                                
                                                
#3 [internal] load .dockerignore
#3 transferring context: 2B done
#3 DONE 0.0s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox:latest@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox:latest@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.1s done
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0.1s done
#5 DONE 0.3s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 0.7s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.0s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.1s done
#8 exporting manifest sha256:6b737098f8b401eab4cab363e346e234e0e60602dfd81fdc606e18df768869c8
#8 exporting manifest sha256:6b737098f8b401eab4cab363e346e234e0e60602dfd81fdc606e18df768869c8 0.0s done
#8 exporting config sha256:42952500208f9c7657ed9f27da357b19ef59b75df63cfbcf30f6ae2203d119c2 0.0s done
#8 naming to localhost/my-image:functional-940017 done
#8 DONE 0.1s
I0717 19:46:57.888768  763028 ssh_runner.go:235] Completed: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.532129478 --local dockerfile=/var/lib/minikube/build/build.532129478 --output type=image,name=localhost/my-image:functional-940017: (2.076716329s)
I0717 19:46:57.888855  763028 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.532129478
I0717 19:46:57.898407  763028 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.532129478.tar
I0717 19:46:57.908237  763028 build_images.go:217] Built localhost/my-image:functional-940017 from /tmp/build.532129478.tar
I0717 19:46:57.908267  763028 build_images.go:133] succeeded building to: functional-940017
I0717 19:46:57.908273  763028 build_images.go:134] failed building to: 
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (2.98s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (0.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull docker.io/kicbase/echo-server:1.0
functional_test.go:346: (dbg) Run:  docker tag docker.io/kicbase/echo-server:1.0 docker.io/kicbase/echo-server:functional-940017
--- PASS: TestFunctional/parallel/ImageCommands/Setup (0.73s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.77s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image load --daemon docker.io/kicbase/echo-server:functional-940017 --alsologtostderr
2024/07/17 19:46:47 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
functional_test.go:354: (dbg) Done: out/minikube-linux-arm64 -p functional-940017 image load --daemon docker.io/kicbase/echo-server:functional-940017 --alsologtostderr: (1.484374026s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.77s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.21s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.19s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.19s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image load --daemon docker.io/kicbase/echo-server:functional-940017 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-linux-arm64 -p functional-940017 image load --daemon docker.io/kicbase/echo-server:functional-940017 --alsologtostderr: (1.222124517s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.51s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.65s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull docker.io/kicbase/echo-server:latest
functional_test.go:239: (dbg) Run:  docker tag docker.io/kicbase/echo-server:latest docker.io/kicbase/echo-server:functional-940017
functional_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image load --daemon docker.io/kicbase/echo-server:functional-940017 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-linux-arm64 -p functional-940017 image load --daemon docker.io/kicbase/echo-server:functional-940017 --alsologtostderr: (1.065184987s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.65s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.75s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image save docker.io/kicbase/echo-server:functional-940017 /home/jenkins/workspace/Docker_Linux_containerd_arm64/echo-server-save.tar --alsologtostderr
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.75s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.48s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image rm docker.io/kicbase/echo-server:functional-940017 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.48s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.68s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image load /home/jenkins/workspace/Docker_Linux_containerd_arm64/echo-server-save.tar --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.68s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi docker.io/kicbase/echo-server:functional-940017
functional_test.go:423: (dbg) Run:  out/minikube-linux-arm64 -p functional-940017 image save --daemon docker.io/kicbase/echo-server:functional-940017 --alsologtostderr
functional_test.go:428: (dbg) Run:  docker image inspect docker.io/kicbase/echo-server:functional-940017
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.73s)

                                                
                                    
x
+
TestFunctional/delete_echo-server_images (0.04s)

                                                
                                                
=== RUN   TestFunctional/delete_echo-server_images
functional_test.go:189: (dbg) Run:  docker rmi -f docker.io/kicbase/echo-server:1.0
functional_test.go:189: (dbg) Run:  docker rmi -f docker.io/kicbase/echo-server:functional-940017
--- PASS: TestFunctional/delete_echo-server_images (0.04s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-940017
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-940017
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StartCluster (125.76s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run:  out/minikube-linux-arm64 start -p ha-751130 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd
E0717 19:48:15.878978  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
E0717 19:48:43.566321  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
ha_test.go:101: (dbg) Done: out/minikube-linux-arm64 start -p ha-751130 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd: (2m4.949714779s)
ha_test.go:107: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 status -v=7 --alsologtostderr
--- PASS: TestMultiControlPlane/serial/StartCluster (125.76s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeployApp (32.82s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:133: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- rollout status deployment/busybox
ha_test.go:133: (dbg) Done: out/minikube-linux-arm64 kubectl -p ha-751130 -- rollout status deployment/busybox: (29.834802804s)
ha_test.go:140: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:163: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- exec busybox-fc5497c4f-g2gbv -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- exec busybox-fc5497c4f-jbxp7 -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- exec busybox-fc5497c4f-wtdc4 -- nslookup kubernetes.io
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- exec busybox-fc5497c4f-g2gbv -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- exec busybox-fc5497c4f-jbxp7 -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- exec busybox-fc5497c4f-wtdc4 -- nslookup kubernetes.default
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- exec busybox-fc5497c4f-g2gbv -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- exec busybox-fc5497c4f-jbxp7 -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- exec busybox-fc5497c4f-wtdc4 -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiControlPlane/serial/DeployApp (32.82s)

                                                
                                    
x
+
TestMultiControlPlane/serial/PingHostFromPods (1.68s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- exec busybox-fc5497c4f-g2gbv -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- exec busybox-fc5497c4f-g2gbv -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- exec busybox-fc5497c4f-jbxp7 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- exec busybox-fc5497c4f-jbxp7 -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- exec busybox-fc5497c4f-wtdc4 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-arm64 kubectl -p ha-751130 -- exec busybox-fc5497c4f-wtdc4 -- sh -c "ping -c 1 192.168.49.1"
--- PASS: TestMultiControlPlane/serial/PingHostFromPods (1.68s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddWorkerNode (24.29s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run:  out/minikube-linux-arm64 node add -p ha-751130 -v=7 --alsologtostderr
ha_test.go:228: (dbg) Done: out/minikube-linux-arm64 node add -p ha-751130 -v=7 --alsologtostderr: (23.280259834s)
ha_test.go:234: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 status -v=7 --alsologtostderr
ha_test.go:234: (dbg) Done: out/minikube-linux-arm64 -p ha-751130 status -v=7 --alsologtostderr: (1.005421581s)
--- PASS: TestMultiControlPlane/serial/AddWorkerNode (24.29s)

                                                
                                    
x
+
TestMultiControlPlane/serial/NodeLabels (0.11s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run:  kubectl --context ha-751130 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiControlPlane/serial/NodeLabels (0.11s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterClusterStart (0.74s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterClusterStart (0.74s)

                                                
                                    
x
+
TestMultiControlPlane/serial/CopyFile (18.96s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/CopyFile
ha_test.go:326: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 status --output json -v=7 --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp testdata/cp-test.txt ha-751130:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile83545426/001/cp-test_ha-751130.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130:/home/docker/cp-test.txt ha-751130-m02:/home/docker/cp-test_ha-751130_ha-751130-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m02 "sudo cat /home/docker/cp-test_ha-751130_ha-751130-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130:/home/docker/cp-test.txt ha-751130-m03:/home/docker/cp-test_ha-751130_ha-751130-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m03 "sudo cat /home/docker/cp-test_ha-751130_ha-751130-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130:/home/docker/cp-test.txt ha-751130-m04:/home/docker/cp-test_ha-751130_ha-751130-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m04 "sudo cat /home/docker/cp-test_ha-751130_ha-751130-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp testdata/cp-test.txt ha-751130-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130-m02:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile83545426/001/cp-test_ha-751130-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130-m02:/home/docker/cp-test.txt ha-751130:/home/docker/cp-test_ha-751130-m02_ha-751130.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130 "sudo cat /home/docker/cp-test_ha-751130-m02_ha-751130.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130-m02:/home/docker/cp-test.txt ha-751130-m03:/home/docker/cp-test_ha-751130-m02_ha-751130-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m03 "sudo cat /home/docker/cp-test_ha-751130-m02_ha-751130-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130-m02:/home/docker/cp-test.txt ha-751130-m04:/home/docker/cp-test_ha-751130-m02_ha-751130-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m04 "sudo cat /home/docker/cp-test_ha-751130-m02_ha-751130-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp testdata/cp-test.txt ha-751130-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130-m03:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile83545426/001/cp-test_ha-751130-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130-m03:/home/docker/cp-test.txt ha-751130:/home/docker/cp-test_ha-751130-m03_ha-751130.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130 "sudo cat /home/docker/cp-test_ha-751130-m03_ha-751130.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130-m03:/home/docker/cp-test.txt ha-751130-m02:/home/docker/cp-test_ha-751130-m03_ha-751130-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m02 "sudo cat /home/docker/cp-test_ha-751130-m03_ha-751130-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130-m03:/home/docker/cp-test.txt ha-751130-m04:/home/docker/cp-test_ha-751130-m03_ha-751130-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m04 "sudo cat /home/docker/cp-test_ha-751130-m03_ha-751130-m04.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp testdata/cp-test.txt ha-751130-m04:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile83545426/001/cp-test_ha-751130-m04.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130-m04:/home/docker/cp-test.txt ha-751130:/home/docker/cp-test_ha-751130-m04_ha-751130.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130 "sudo cat /home/docker/cp-test_ha-751130-m04_ha-751130.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130-m04:/home/docker/cp-test.txt ha-751130-m02:/home/docker/cp-test_ha-751130-m04_ha-751130-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m02 "sudo cat /home/docker/cp-test_ha-751130-m04_ha-751130-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 cp ha-751130-m04:/home/docker/cp-test.txt ha-751130-m03:/home/docker/cp-test_ha-751130-m04_ha-751130-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 ssh -n ha-751130-m03 "sudo cat /home/docker/cp-test_ha-751130-m04_ha-751130-m03.txt"
--- PASS: TestMultiControlPlane/serial/CopyFile (18.96s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopSecondaryNode (12.94s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopSecondaryNode
ha_test.go:363: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 node stop m02 -v=7 --alsologtostderr
ha_test.go:363: (dbg) Done: out/minikube-linux-arm64 -p ha-751130 node stop m02 -v=7 --alsologtostderr: (12.157301463s)
ha_test.go:369: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 status -v=7 --alsologtostderr
ha_test.go:369: (dbg) Non-zero exit: out/minikube-linux-arm64 -p ha-751130 status -v=7 --alsologtostderr: exit status 7 (775.917677ms)

                                                
                                                
-- stdout --
	ha-751130
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-751130-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-751130-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-751130-m04
	type: Worker
	host: Running
	kubelet: Running
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 19:50:37.914646  779486 out.go:291] Setting OutFile to fd 1 ...
	I0717 19:50:37.914787  779486 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 19:50:37.914797  779486 out.go:304] Setting ErrFile to fd 2...
	I0717 19:50:37.914803  779486 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 19:50:37.915090  779486 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
	I0717 19:50:37.915304  779486 out.go:298] Setting JSON to false
	I0717 19:50:37.915342  779486 mustload.go:65] Loading cluster: ha-751130
	I0717 19:50:37.915431  779486 notify.go:220] Checking for updates...
	I0717 19:50:37.915759  779486 config.go:182] Loaded profile config "ha-751130": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
	I0717 19:50:37.915777  779486 status.go:255] checking status of ha-751130 ...
	I0717 19:50:37.916453  779486 cli_runner.go:164] Run: docker container inspect ha-751130 --format={{.State.Status}}
	I0717 19:50:37.936927  779486 status.go:330] ha-751130 host status = "Running" (err=<nil>)
	I0717 19:50:37.936949  779486 host.go:66] Checking if "ha-751130" exists ...
	I0717 19:50:37.937348  779486 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-751130
	I0717 19:50:37.956743  779486 host.go:66] Checking if "ha-751130" exists ...
	I0717 19:50:37.957067  779486 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0717 19:50:37.957127  779486 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-751130
	I0717 19:50:37.982916  779486 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33549 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/ha-751130/id_rsa Username:docker}
	I0717 19:50:38.082423  779486 ssh_runner.go:195] Run: systemctl --version
	I0717 19:50:38.087648  779486 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 19:50:38.102483  779486 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 19:50:38.182455  779486 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:71 SystemTime:2024-07-17 19:50:38.171838897 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0717 19:50:38.183013  779486 kubeconfig.go:125] found "ha-751130" server: "https://192.168.49.254:8443"
	I0717 19:50:38.183048  779486 api_server.go:166] Checking apiserver status ...
	I0717 19:50:38.183095  779486 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0717 19:50:38.198603  779486 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1467/cgroup
	I0717 19:50:38.209697  779486 api_server.go:182] apiserver freezer: "2:freezer:/docker/89d1d0174832d7b8ce4a9199607e60385d40c4e3cbc10c571e8b161f6faae38a/kubepods/burstable/poddf9fe31a583d5c63b78be8e40be8013c/2d82a00e0b632758d64eac8cbb70a733fb467c1fbcc52b5b3c9715ea7bde5b07"
	I0717 19:50:38.209783  779486 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/89d1d0174832d7b8ce4a9199607e60385d40c4e3cbc10c571e8b161f6faae38a/kubepods/burstable/poddf9fe31a583d5c63b78be8e40be8013c/2d82a00e0b632758d64eac8cbb70a733fb467c1fbcc52b5b3c9715ea7bde5b07/freezer.state
	I0717 19:50:38.218814  779486 api_server.go:204] freezer state: "THAWED"
	I0717 19:50:38.218845  779486 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0717 19:50:38.226655  779486 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0717 19:50:38.226684  779486 status.go:422] ha-751130 apiserver status = Running (err=<nil>)
	I0717 19:50:38.226696  779486 status.go:257] ha-751130 status: &{Name:ha-751130 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0717 19:50:38.226725  779486 status.go:255] checking status of ha-751130-m02 ...
	I0717 19:50:38.227043  779486 cli_runner.go:164] Run: docker container inspect ha-751130-m02 --format={{.State.Status}}
	I0717 19:50:38.244424  779486 status.go:330] ha-751130-m02 host status = "Stopped" (err=<nil>)
	I0717 19:50:38.244449  779486 status.go:343] host is not running, skipping remaining checks
	I0717 19:50:38.244458  779486 status.go:257] ha-751130-m02 status: &{Name:ha-751130-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0717 19:50:38.244478  779486 status.go:255] checking status of ha-751130-m03 ...
	I0717 19:50:38.244809  779486 cli_runner.go:164] Run: docker container inspect ha-751130-m03 --format={{.State.Status}}
	I0717 19:50:38.261741  779486 status.go:330] ha-751130-m03 host status = "Running" (err=<nil>)
	I0717 19:50:38.261767  779486 host.go:66] Checking if "ha-751130-m03" exists ...
	I0717 19:50:38.262129  779486 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-751130-m03
	I0717 19:50:38.279484  779486 host.go:66] Checking if "ha-751130-m03" exists ...
	I0717 19:50:38.279796  779486 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0717 19:50:38.279846  779486 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-751130-m03
	I0717 19:50:38.298290  779486 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33559 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/ha-751130-m03/id_rsa Username:docker}
	I0717 19:50:38.386189  779486 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 19:50:38.401149  779486 kubeconfig.go:125] found "ha-751130" server: "https://192.168.49.254:8443"
	I0717 19:50:38.401197  779486 api_server.go:166] Checking apiserver status ...
	I0717 19:50:38.401243  779486 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0717 19:50:38.415186  779486 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1391/cgroup
	I0717 19:50:38.427860  779486 api_server.go:182] apiserver freezer: "2:freezer:/docker/eee9db70673017d75f2526e8d4367b4ee26f236d25cbef9433cd860387cf0d01/kubepods/burstable/pod1fa5060345f5273cd21d2079e6d1f867/5911c19237606d5638bcef4b3a13ee9152dd682b8bf3f7821e45d19e08300588"
	I0717 19:50:38.427958  779486 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/eee9db70673017d75f2526e8d4367b4ee26f236d25cbef9433cd860387cf0d01/kubepods/burstable/pod1fa5060345f5273cd21d2079e6d1f867/5911c19237606d5638bcef4b3a13ee9152dd682b8bf3f7821e45d19e08300588/freezer.state
	I0717 19:50:38.440377  779486 api_server.go:204] freezer state: "THAWED"
	I0717 19:50:38.440412  779486 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0717 19:50:38.451379  779486 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0717 19:50:38.451412  779486 status.go:422] ha-751130-m03 apiserver status = Running (err=<nil>)
	I0717 19:50:38.451422  779486 status.go:257] ha-751130-m03 status: &{Name:ha-751130-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0717 19:50:38.451468  779486 status.go:255] checking status of ha-751130-m04 ...
	I0717 19:50:38.451849  779486 cli_runner.go:164] Run: docker container inspect ha-751130-m04 --format={{.State.Status}}
	I0717 19:50:38.481146  779486 status.go:330] ha-751130-m04 host status = "Running" (err=<nil>)
	I0717 19:50:38.481180  779486 host.go:66] Checking if "ha-751130-m04" exists ...
	I0717 19:50:38.481665  779486 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-751130-m04
	I0717 19:50:38.506421  779486 host.go:66] Checking if "ha-751130-m04" exists ...
	I0717 19:50:38.506728  779486 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0717 19:50:38.506769  779486 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-751130-m04
	I0717 19:50:38.528473  779486 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33564 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/ha-751130-m04/id_rsa Username:docker}
	I0717 19:50:38.616995  779486 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 19:50:38.629433  779486 status.go:257] ha-751130-m04 status: &{Name:ha-751130-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopSecondaryNode (12.94s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.56s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:390: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.56s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartSecondaryNode (18.71s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode
ha_test.go:420: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 node start m02 -v=7 --alsologtostderr
ha_test.go:420: (dbg) Done: out/minikube-linux-arm64 -p ha-751130 node start m02 -v=7 --alsologtostderr: (17.616132172s)
ha_test.go:428: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 status -v=7 --alsologtostderr
ha_test.go:448: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiControlPlane/serial/RestartSecondaryNode (18.71s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.76s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.76s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartClusterKeepsNodes (138.51s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:456: (dbg) Run:  out/minikube-linux-arm64 node list -p ha-751130 -v=7 --alsologtostderr
ha_test.go:462: (dbg) Run:  out/minikube-linux-arm64 stop -p ha-751130 -v=7 --alsologtostderr
E0717 19:51:06.519249  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 19:51:06.524598  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 19:51:06.534889  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 19:51:06.555183  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 19:51:06.596147  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 19:51:06.676567  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 19:51:06.837071  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 19:51:07.157486  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 19:51:07.797950  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 19:51:09.078213  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 19:51:11.639876  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 19:51:16.760074  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 19:51:27.001100  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
ha_test.go:462: (dbg) Done: out/minikube-linux-arm64 stop -p ha-751130 -v=7 --alsologtostderr: (37.490191735s)
ha_test.go:467: (dbg) Run:  out/minikube-linux-arm64 start -p ha-751130 --wait=true -v=7 --alsologtostderr
E0717 19:51:47.481444  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 19:52:28.441663  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 19:53:15.878125  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
ha_test.go:467: (dbg) Done: out/minikube-linux-arm64 start -p ha-751130 --wait=true -v=7 --alsologtostderr: (1m40.860873831s)
ha_test.go:472: (dbg) Run:  out/minikube-linux-arm64 node list -p ha-751130
--- PASS: TestMultiControlPlane/serial/RestartClusterKeepsNodes (138.51s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeleteSecondaryNode (10.95s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode
ha_test.go:487: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 node delete m03 -v=7 --alsologtostderr
ha_test.go:487: (dbg) Done: out/minikube-linux-arm64 -p ha-751130 node delete m03 -v=7 --alsologtostderr: (9.974822518s)
ha_test.go:493: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 status -v=7 --alsologtostderr
ha_test.go:511: (dbg) Run:  kubectl get nodes
ha_test.go:519: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/DeleteSecondaryNode (10.95s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.53s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:390: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.53s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopCluster (36.27s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopCluster
ha_test.go:531: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 stop -v=7 --alsologtostderr
E0717 19:53:50.362606  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
ha_test.go:531: (dbg) Done: out/minikube-linux-arm64 -p ha-751130 stop -v=7 --alsologtostderr: (36.150782725s)
ha_test.go:537: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 status -v=7 --alsologtostderr
ha_test.go:537: (dbg) Non-zero exit: out/minikube-linux-arm64 -p ha-751130 status -v=7 --alsologtostderr: exit status 7 (114.960924ms)

                                                
                                                
-- stdout --
	ha-751130
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-751130-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-751130-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 19:54:04.862465  793872 out.go:291] Setting OutFile to fd 1 ...
	I0717 19:54:04.862674  793872 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 19:54:04.862701  793872 out.go:304] Setting ErrFile to fd 2...
	I0717 19:54:04.862722  793872 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 19:54:04.863017  793872 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
	I0717 19:54:04.863248  793872 out.go:298] Setting JSON to false
	I0717 19:54:04.863314  793872 mustload.go:65] Loading cluster: ha-751130
	I0717 19:54:04.863401  793872 notify.go:220] Checking for updates...
	I0717 19:54:04.863820  793872 config.go:182] Loaded profile config "ha-751130": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
	I0717 19:54:04.863869  793872 status.go:255] checking status of ha-751130 ...
	I0717 19:54:04.864448  793872 cli_runner.go:164] Run: docker container inspect ha-751130 --format={{.State.Status}}
	I0717 19:54:04.882918  793872 status.go:330] ha-751130 host status = "Stopped" (err=<nil>)
	I0717 19:54:04.882941  793872 status.go:343] host is not running, skipping remaining checks
	I0717 19:54:04.882949  793872 status.go:257] ha-751130 status: &{Name:ha-751130 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0717 19:54:04.882978  793872 status.go:255] checking status of ha-751130-m02 ...
	I0717 19:54:04.883270  793872 cli_runner.go:164] Run: docker container inspect ha-751130-m02 --format={{.State.Status}}
	I0717 19:54:04.900076  793872 status.go:330] ha-751130-m02 host status = "Stopped" (err=<nil>)
	I0717 19:54:04.900101  793872 status.go:343] host is not running, skipping remaining checks
	I0717 19:54:04.900107  793872 status.go:257] ha-751130-m02 status: &{Name:ha-751130-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0717 19:54:04.900128  793872 status.go:255] checking status of ha-751130-m04 ...
	I0717 19:54:04.900421  793872 cli_runner.go:164] Run: docker container inspect ha-751130-m04 --format={{.State.Status}}
	I0717 19:54:04.929519  793872 status.go:330] ha-751130-m04 host status = "Stopped" (err=<nil>)
	I0717 19:54:04.929544  793872 status.go:343] host is not running, skipping remaining checks
	I0717 19:54:04.929552  793872 status.go:257] ha-751130-m04 status: &{Name:ha-751130-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopCluster (36.27s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartCluster (78.34s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartCluster
ha_test.go:560: (dbg) Run:  out/minikube-linux-arm64 start -p ha-751130 --wait=true -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd
ha_test.go:560: (dbg) Done: out/minikube-linux-arm64 start -p ha-751130 --wait=true -v=7 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m17.376163997s)
ha_test.go:566: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 status -v=7 --alsologtostderr
ha_test.go:584: (dbg) Run:  kubectl get nodes
ha_test.go:592: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/RestartCluster (78.34s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.53s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:390: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.53s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddSecondaryNode (47.04s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddSecondaryNode
ha_test.go:605: (dbg) Run:  out/minikube-linux-arm64 node add -p ha-751130 --control-plane -v=7 --alsologtostderr
E0717 19:56:06.519242  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
ha_test.go:605: (dbg) Done: out/minikube-linux-arm64 node add -p ha-751130 --control-plane -v=7 --alsologtostderr: (46.005732313s)
ha_test.go:611: (dbg) Run:  out/minikube-linux-arm64 -p ha-751130 status -v=7 --alsologtostderr
ha_test.go:611: (dbg) Done: out/minikube-linux-arm64 -p ha-751130 status -v=7 --alsologtostderr: (1.03753853s)
--- PASS: TestMultiControlPlane/serial/AddSecondaryNode (47.04s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.76s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.76s)

                                                
                                    
x
+
TestJSONOutput/start/Command (58.97s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-491331 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd
E0717 19:56:34.202828  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 start -p json-output-491331 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd: (58.964657366s)
--- PASS: TestJSONOutput/start/Command (58.97s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.74s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 pause -p json-output-491331 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.74s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.68s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 unpause -p json-output-491331 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.68s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.82s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 stop -p json-output-491331 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 stop -p json-output-491331 --output=json --user=testUser: (5.81779814s)
--- PASS: TestJSONOutput/stop/Command (5.82s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.22s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-error-369567 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p json-output-error-369567 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (78.221247ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"ef4aa4f9-be30-4f64-bf77-2aa0909e9660","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-369567] minikube v1.33.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"23bf1203-6190-4aed-92f0-59cc1a4b96e8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19282"}}
	{"specversion":"1.0","id":"66871440-e34c-47c4-abb5-08b43bcdd052","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"6c92f066-7b7e-4f4d-912b-1ba9bfb158e2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig"}}
	{"specversion":"1.0","id":"c27cda21-2d8a-41dc-b926-4afc65e8f1c2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube"}}
	{"specversion":"1.0","id":"2fc4a532-4c5e-41cf-8344-e93dea6715c2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"4010d1b0-7662-4421-a24c-63fba704433f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"4d091cbb-1b6a-4c24-a5bf-2bdfa2a2766b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-369567" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p json-output-error-369567
--- PASS: TestErrorJSONOutput (0.22s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (38.44s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-332485 --network=
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-332485 --network=: (36.320189099s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-332485" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-332485
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-332485: (2.096579585s)
--- PASS: TestKicCustomNetwork/create_custom_network (38.44s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (33.44s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-353865 --network=bridge
E0717 19:58:15.878390  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-353865 --network=bridge: (31.401202611s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-353865" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-353865
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-353865: (2.020071685s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (33.44s)

                                                
                                    
x
+
TestKicExistingNetwork (35.59s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-arm64 start -p existing-network-459519 --network=existing-network
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-arm64 start -p existing-network-459519 --network=existing-network: (33.464681059s)
helpers_test.go:175: Cleaning up "existing-network-459519" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p existing-network-459519
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p existing-network-459519: (1.973201471s)
--- PASS: TestKicExistingNetwork (35.59s)

                                                
                                    
x
+
TestKicCustomSubnet (36.48s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-subnet-766432 --subnet=192.168.60.0/24
E0717 19:59:38.926551  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-subnet-766432 --subnet=192.168.60.0/24: (34.323273515s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-766432 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-766432" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p custom-subnet-766432
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p custom-subnet-766432: (2.134103613s)
--- PASS: TestKicCustomSubnet (36.48s)

                                                
                                    
x
+
TestKicStaticIP (35.58s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-arm64 start -p static-ip-597025 --static-ip=192.168.200.200
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-arm64 start -p static-ip-597025 --static-ip=192.168.200.200: (33.219580135s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-arm64 -p static-ip-597025 ip
helpers_test.go:175: Cleaning up "static-ip-597025" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p static-ip-597025
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p static-ip-597025: (2.22169357s)
--- PASS: TestKicStaticIP (35.58s)

                                                
                                    
x
+
TestMainNoArgs (0.05s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-arm64
--- PASS: TestMainNoArgs (0.05s)

                                                
                                    
x
+
TestMinikubeProfile (73s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p first-479105 --driver=docker  --container-runtime=containerd
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p first-479105 --driver=docker  --container-runtime=containerd: (32.391782683s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p second-481821 --driver=docker  --container-runtime=containerd
E0717 20:01:06.519558  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p second-481821 --driver=docker  --container-runtime=containerd: (35.154234026s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile first-479105
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile second-481821
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
helpers_test.go:175: Cleaning up "second-481821" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p second-481821
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p second-481821: (1.988758321s)
helpers_test.go:175: Cleaning up "first-479105" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p first-479105
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p first-479105: (2.232862923s)
--- PASS: TestMinikubeProfile (73.00s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (6.65s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-1-395125 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-1-395125 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (5.644283801s)
--- PASS: TestMountStart/serial/StartWithMountFirst (6.65s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.25s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-1-395125 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.25s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (9.1s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-408844 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-408844 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (8.097245825s)
--- PASS: TestMountStart/serial/StartWithMountSecond (9.10s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.24s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-408844 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.24s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.79s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p mount-start-1-395125 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p mount-start-1-395125 --alsologtostderr -v=5: (1.791432162s)
--- PASS: TestMountStart/serial/DeleteFirst (1.79s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.26s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-408844 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.26s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.2s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-arm64 stop -p mount-start-2-408844
mount_start_test.go:155: (dbg) Done: out/minikube-linux-arm64 stop -p mount-start-2-408844: (1.199526289s)
--- PASS: TestMountStart/serial/Stop (1.20s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (8.15s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-408844
mount_start_test.go:166: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-408844: (7.147371323s)
--- PASS: TestMountStart/serial/RestartStopped (8.15s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.25s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-408844 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.25s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (76.75s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-074943 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
E0717 20:03:15.878503  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
multinode_test.go:96: (dbg) Done: out/minikube-linux-arm64 start -p multinode-074943 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m16.234474854s)
multinode_test.go:102: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (76.75s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (16.47s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-074943 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:498: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-074943 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-074943 -- rollout status deployment/busybox: (14.332197442s)
multinode_test.go:505: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-074943 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:528: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-074943 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:536: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-074943 -- exec busybox-fc5497c4f-4cm6v -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-074943 -- exec busybox-fc5497c4f-cx8gk -- nslookup kubernetes.io
multinode_test.go:546: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-074943 -- exec busybox-fc5497c4f-4cm6v -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-074943 -- exec busybox-fc5497c4f-cx8gk -- nslookup kubernetes.default
multinode_test.go:554: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-074943 -- exec busybox-fc5497c4f-4cm6v -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-074943 -- exec busybox-fc5497c4f-cx8gk -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (16.47s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.99s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-074943 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:572: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-074943 -- exec busybox-fc5497c4f-4cm6v -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-074943 -- exec busybox-fc5497c4f-4cm6v -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:572: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-074943 -- exec busybox-fc5497c4f-cx8gk -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-074943 -- exec busybox-fc5497c4f-cx8gk -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (0.99s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (16.74s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-074943 -v 3 --alsologtostderr
multinode_test.go:121: (dbg) Done: out/minikube-linux-arm64 node add -p multinode-074943 -v 3 --alsologtostderr: (16.037633224s)
multinode_test.go:127: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (16.74s)

                                                
                                    
x
+
TestMultiNode/serial/MultiNodeLabels (0.09s)

                                                
                                                
=== RUN   TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run:  kubectl --context multinode-074943 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiNode/serial/MultiNodeLabels (0.09s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.33s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.33s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (9.86s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 cp testdata/cp-test.txt multinode-074943:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 cp multinode-074943:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile3200947943/001/cp-test_multinode-074943.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 cp multinode-074943:/home/docker/cp-test.txt multinode-074943-m02:/home/docker/cp-test_multinode-074943_multinode-074943-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943-m02 "sudo cat /home/docker/cp-test_multinode-074943_multinode-074943-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 cp multinode-074943:/home/docker/cp-test.txt multinode-074943-m03:/home/docker/cp-test_multinode-074943_multinode-074943-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943-m03 "sudo cat /home/docker/cp-test_multinode-074943_multinode-074943-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 cp testdata/cp-test.txt multinode-074943-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 cp multinode-074943-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile3200947943/001/cp-test_multinode-074943-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 cp multinode-074943-m02:/home/docker/cp-test.txt multinode-074943:/home/docker/cp-test_multinode-074943-m02_multinode-074943.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943 "sudo cat /home/docker/cp-test_multinode-074943-m02_multinode-074943.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 cp multinode-074943-m02:/home/docker/cp-test.txt multinode-074943-m03:/home/docker/cp-test_multinode-074943-m02_multinode-074943-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943-m03 "sudo cat /home/docker/cp-test_multinode-074943-m02_multinode-074943-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 cp testdata/cp-test.txt multinode-074943-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 cp multinode-074943-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile3200947943/001/cp-test_multinode-074943-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 cp multinode-074943-m03:/home/docker/cp-test.txt multinode-074943:/home/docker/cp-test_multinode-074943-m03_multinode-074943.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943 "sudo cat /home/docker/cp-test_multinode-074943-m03_multinode-074943.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 cp multinode-074943-m03:/home/docker/cp-test.txt multinode-074943-m02:/home/docker/cp-test_multinode-074943-m03_multinode-074943-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 ssh -n multinode-074943-m02 "sudo cat /home/docker/cp-test_multinode-074943-m03_multinode-074943-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (9.86s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.22s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 node stop m03
multinode_test.go:248: (dbg) Done: out/minikube-linux-arm64 -p multinode-074943 node stop m03: (1.210487669s)
multinode_test.go:254: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-074943 status: exit status 7 (516.027791ms)

                                                
                                                
-- stdout --
	multinode-074943
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-074943-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-074943-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-074943 status --alsologtostderr: exit status 7 (496.936637ms)

                                                
                                                
-- stdout --
	multinode-074943
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-074943-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-074943-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 20:04:16.161246  848099 out.go:291] Setting OutFile to fd 1 ...
	I0717 20:04:16.161467  848099 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 20:04:16.161500  848099 out.go:304] Setting ErrFile to fd 2...
	I0717 20:04:16.161521  848099 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 20:04:16.161787  848099 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
	I0717 20:04:16.162076  848099 out.go:298] Setting JSON to false
	I0717 20:04:16.162143  848099 mustload.go:65] Loading cluster: multinode-074943
	I0717 20:04:16.162234  848099 notify.go:220] Checking for updates...
	I0717 20:04:16.162691  848099 config.go:182] Loaded profile config "multinode-074943": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
	I0717 20:04:16.162736  848099 status.go:255] checking status of multinode-074943 ...
	I0717 20:04:16.163253  848099 cli_runner.go:164] Run: docker container inspect multinode-074943 --format={{.State.Status}}
	I0717 20:04:16.185205  848099 status.go:330] multinode-074943 host status = "Running" (err=<nil>)
	I0717 20:04:16.185235  848099 host.go:66] Checking if "multinode-074943" exists ...
	I0717 20:04:16.185560  848099 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-074943
	I0717 20:04:16.214271  848099 host.go:66] Checking if "multinode-074943" exists ...
	I0717 20:04:16.214673  848099 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0717 20:04:16.214763  848099 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-074943
	I0717 20:04:16.232702  848099 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33669 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/multinode-074943/id_rsa Username:docker}
	I0717 20:04:16.321249  848099 ssh_runner.go:195] Run: systemctl --version
	I0717 20:04:16.326126  848099 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 20:04:16.338623  848099 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:04:16.392441  848099 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:61 SystemTime:2024-07-17 20:04:16.381942155 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0717 20:04:16.393034  848099 kubeconfig.go:125] found "multinode-074943" server: "https://192.168.58.2:8443"
	I0717 20:04:16.393068  848099 api_server.go:166] Checking apiserver status ...
	I0717 20:04:16.393118  848099 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0717 20:04:16.405025  848099 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1448/cgroup
	I0717 20:04:16.414923  848099 api_server.go:182] apiserver freezer: "2:freezer:/docker/cdccecd106263c30fbe07145b744eaf8742ff932d25c560c203f1c1eb16fbe53/kubepods/burstable/pod3a58003915af1a34366069ed85de1d59/0a6d31db0b41de11273ef9eb1feb073c3dd6d8ae847c54b142e4df3d98f0a757"
	I0717 20:04:16.415011  848099 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/cdccecd106263c30fbe07145b744eaf8742ff932d25c560c203f1c1eb16fbe53/kubepods/burstable/pod3a58003915af1a34366069ed85de1d59/0a6d31db0b41de11273ef9eb1feb073c3dd6d8ae847c54b142e4df3d98f0a757/freezer.state
	I0717 20:04:16.424957  848099 api_server.go:204] freezer state: "THAWED"
	I0717 20:04:16.424987  848099 api_server.go:253] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I0717 20:04:16.433491  848099 api_server.go:279] https://192.168.58.2:8443/healthz returned 200:
	ok
	I0717 20:04:16.433529  848099 status.go:422] multinode-074943 apiserver status = Running (err=<nil>)
	I0717 20:04:16.433541  848099 status.go:257] multinode-074943 status: &{Name:multinode-074943 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0717 20:04:16.433560  848099 status.go:255] checking status of multinode-074943-m02 ...
	I0717 20:04:16.433865  848099 cli_runner.go:164] Run: docker container inspect multinode-074943-m02 --format={{.State.Status}}
	I0717 20:04:16.450124  848099 status.go:330] multinode-074943-m02 host status = "Running" (err=<nil>)
	I0717 20:04:16.450154  848099 host.go:66] Checking if "multinode-074943-m02" exists ...
	I0717 20:04:16.450463  848099 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-074943-m02
	I0717 20:04:16.467035  848099 host.go:66] Checking if "multinode-074943-m02" exists ...
	I0717 20:04:16.467359  848099 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0717 20:04:16.467405  848099 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-074943-m02
	I0717 20:04:16.483781  848099 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33674 SSHKeyPath:/home/jenkins/minikube-integration/19282-720845/.minikube/machines/multinode-074943-m02/id_rsa Username:docker}
	I0717 20:04:16.569365  848099 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 20:04:16.582079  848099 status.go:257] multinode-074943-m02 status: &{Name:multinode-074943-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0717 20:04:16.582166  848099 status.go:255] checking status of multinode-074943-m03 ...
	I0717 20:04:16.582551  848099 cli_runner.go:164] Run: docker container inspect multinode-074943-m03 --format={{.State.Status}}
	I0717 20:04:16.599577  848099 status.go:330] multinode-074943-m03 host status = "Stopped" (err=<nil>)
	I0717 20:04:16.599598  848099 status.go:343] host is not running, skipping remaining checks
	I0717 20:04:16.599606  848099 status.go:257] multinode-074943-m03 status: &{Name:multinode-074943-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.22s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (9.46s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 node start m03 -v=7 --alsologtostderr
multinode_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p multinode-074943 node start m03 -v=7 --alsologtostderr: (8.699665547s)
multinode_test.go:290: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 status -v=7 --alsologtostderr
multinode_test.go:306: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (9.46s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (89.23s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-074943
multinode_test.go:321: (dbg) Run:  out/minikube-linux-arm64 stop -p multinode-074943
multinode_test.go:321: (dbg) Done: out/minikube-linux-arm64 stop -p multinode-074943: (25.055816394s)
multinode_test.go:326: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-074943 --wait=true -v=8 --alsologtostderr
multinode_test.go:326: (dbg) Done: out/minikube-linux-arm64 start -p multinode-074943 --wait=true -v=8 --alsologtostderr: (1m4.048201667s)
multinode_test.go:331: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-074943
--- PASS: TestMultiNode/serial/RestartKeepsNodes (89.23s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.75s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 node delete m03
multinode_test.go:416: (dbg) Done: out/minikube-linux-arm64 -p multinode-074943 node delete m03: (4.786446825s)
multinode_test.go:422: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 status --alsologtostderr
multinode_test.go:436: (dbg) Run:  kubectl get nodes
multinode_test.go:444: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.75s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (24.08s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 stop
E0717 20:06:06.519473  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
multinode_test.go:345: (dbg) Done: out/minikube-linux-arm64 -p multinode-074943 stop: (23.893183869s)
multinode_test.go:351: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-074943 status: exit status 7 (96.210934ms)

                                                
                                                
-- stdout --
	multinode-074943
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-074943-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:358: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-074943 status --alsologtostderr: exit status 7 (95.133295ms)

                                                
                                                
-- stdout --
	multinode-074943
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-074943-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 20:06:25.080179  856106 out.go:291] Setting OutFile to fd 1 ...
	I0717 20:06:25.080368  856106 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 20:06:25.080400  856106 out.go:304] Setting ErrFile to fd 2...
	I0717 20:06:25.080423  856106 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 20:06:25.080708  856106 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
	I0717 20:06:25.080949  856106 out.go:298] Setting JSON to false
	I0717 20:06:25.081024  856106 mustload.go:65] Loading cluster: multinode-074943
	I0717 20:06:25.081106  856106 notify.go:220] Checking for updates...
	I0717 20:06:25.081481  856106 config.go:182] Loaded profile config "multinode-074943": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
	I0717 20:06:25.081515  856106 status.go:255] checking status of multinode-074943 ...
	I0717 20:06:25.082020  856106 cli_runner.go:164] Run: docker container inspect multinode-074943 --format={{.State.Status}}
	I0717 20:06:25.101337  856106 status.go:330] multinode-074943 host status = "Stopped" (err=<nil>)
	I0717 20:06:25.101365  856106 status.go:343] host is not running, skipping remaining checks
	I0717 20:06:25.101374  856106 status.go:257] multinode-074943 status: &{Name:multinode-074943 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0717 20:06:25.101415  856106 status.go:255] checking status of multinode-074943-m02 ...
	I0717 20:06:25.101732  856106 cli_runner.go:164] Run: docker container inspect multinode-074943-m02 --format={{.State.Status}}
	I0717 20:06:25.128186  856106 status.go:330] multinode-074943-m02 host status = "Stopped" (err=<nil>)
	I0717 20:06:25.128208  856106 status.go:343] host is not running, skipping remaining checks
	I0717 20:06:25.128216  856106 status.go:257] multinode-074943-m02 status: &{Name:multinode-074943-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (24.08s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (56.13s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-074943 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
multinode_test.go:376: (dbg) Done: out/minikube-linux-arm64 start -p multinode-074943 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (55.436186004s)
multinode_test.go:382: (dbg) Run:  out/minikube-linux-arm64 -p multinode-074943 status --alsologtostderr
multinode_test.go:396: (dbg) Run:  kubectl get nodes
multinode_test.go:404: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (56.13s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (35.43s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-074943
multinode_test.go:464: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-074943-m02 --driver=docker  --container-runtime=containerd
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p multinode-074943-m02 --driver=docker  --container-runtime=containerd: exit status 14 (80.703195ms)

                                                
                                                
-- stdout --
	* [multinode-074943-m02] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19282
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-074943-m02' is duplicated with machine name 'multinode-074943-m02' in profile 'multinode-074943'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-074943-m03 --driver=docker  --container-runtime=containerd
E0717 20:07:29.565152  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
multinode_test.go:472: (dbg) Done: out/minikube-linux-arm64 start -p multinode-074943-m03 --driver=docker  --container-runtime=containerd: (33.011408947s)
multinode_test.go:479: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-074943
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-linux-arm64 node add -p multinode-074943: exit status 80 (318.529226ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-074943 as [worker]
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-074943-m03 already exists in multinode-074943-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:484: (dbg) Run:  out/minikube-linux-arm64 delete -p multinode-074943-m03
multinode_test.go:484: (dbg) Done: out/minikube-linux-arm64 delete -p multinode-074943-m03: (1.966030938s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (35.43s)

                                                
                                    
x
+
TestPreload (110.49s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-989001 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4
E0717 20:08:15.878409  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
preload_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-989001 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4: (1m14.029673437s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-989001 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-arm64 -p test-preload-989001 image pull gcr.io/k8s-minikube/busybox: (1.199121168s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-arm64 stop -p test-preload-989001
preload_test.go:58: (dbg) Done: out/minikube-linux-arm64 stop -p test-preload-989001: (12.043006633s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-989001 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd
preload_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-989001 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd: (20.513049749s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-989001 image list
helpers_test.go:175: Cleaning up "test-preload-989001" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p test-preload-989001
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p test-preload-989001: (2.340920811s)
--- PASS: TestPreload (110.49s)

                                                
                                    
x
+
TestScheduledStopUnix (109.35s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-arm64 start -p scheduled-stop-054844 --memory=2048 --driver=docker  --container-runtime=containerd
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-054844 --memory=2048 --driver=docker  --container-runtime=containerd: (32.536356491s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-054844 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-054844 -n scheduled-stop-054844
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-054844 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-054844 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-054844 -n scheduled-stop-054844
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-054844
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-054844 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
E0717 20:11:06.519549  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-054844
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p scheduled-stop-054844: exit status 7 (65.356003ms)

                                                
                                                
-- stdout --
	scheduled-stop-054844
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-054844 -n scheduled-stop-054844
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-054844 -n scheduled-stop-054844: exit status 7 (72.585716ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-054844" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p scheduled-stop-054844
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-054844: (5.283266802s)
--- PASS: TestScheduledStopUnix (109.35s)

                                                
                                    
x
+
TestInsufficientStorage (10.34s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-arm64 start -p insufficient-storage-594734 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p insufficient-storage-594734 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd: exit status 26 (7.854744695s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"903f9986-9b19-4b54-b433-3ca975a3d549","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-594734] minikube v1.33.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"39a804e2-ea7b-46c2-bec6-92248009c302","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=19282"}}
	{"specversion":"1.0","id":"a8c13232-f0c1-4a87-b2dc-00aa2f316a6b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"2cd70017-e8c7-481b-8d1a-b2606775aa6c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig"}}
	{"specversion":"1.0","id":"69ee002f-306a-4608-88e2-c1ec56709742","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube"}}
	{"specversion":"1.0","id":"e62c83e3-38cf-48df-8e64-9e7133bcb904","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"628f48cf-2e20-4449-90f2-48a981c7b7bd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"3a4623a9-ad19-4088-b4b6-045a436077f9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"d4dfc860-b4b4-443f-9910-992fd1285a8d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"06ad59ca-01cf-4609-9204-aefe8cced719","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"202f7469-698d-4071-b291-d3cacc871f72","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"51ddb03c-1742-49ee-93e5-6881dc4414be","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"insufficient-storage-594734\" primary control-plane node in \"insufficient-storage-594734\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"2555d38c-5061-4e6b-be86-4662067b2601","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image v0.0.44-1721234491-19282 ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"9487ccc4-51e1-47b3-aace-14f7b118819d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"80e451b1-15ad-49cb-9b26-4f039478ae62","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-594734 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-594734 --output=json --layout=cluster: exit status 7 (276.793103ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-594734","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.33.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-594734","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0717 20:11:49.075047  874849 status.go:417] kubeconfig endpoint: get endpoint: "insufficient-storage-594734" does not appear in /home/jenkins/minikube-integration/19282-720845/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-594734 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-594734 --output=json --layout=cluster: exit status 7 (278.678126ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-594734","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.33.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-594734","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0717 20:11:49.353563  874910 status.go:417] kubeconfig endpoint: get endpoint: "insufficient-storage-594734" does not appear in /home/jenkins/minikube-integration/19282-720845/kubeconfig
	E0717 20:11:49.364191  874910 status.go:560] unable to read event log: stat: stat /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/insufficient-storage-594734/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-594734" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p insufficient-storage-594734
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p insufficient-storage-594734: (1.932194535s)
--- PASS: TestInsufficientStorage (10.34s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (87.19s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run:  /tmp/minikube-v1.26.0.2832151618 start -p running-upgrade-247960 --memory=2200 --vm-driver=docker  --container-runtime=containerd
E0717 20:18:15.877986  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
version_upgrade_test.go:120: (dbg) Done: /tmp/minikube-v1.26.0.2832151618 start -p running-upgrade-247960 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (45.64189817s)
version_upgrade_test.go:130: (dbg) Run:  out/minikube-linux-arm64 start -p running-upgrade-247960 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:130: (dbg) Done: out/minikube-linux-arm64 start -p running-upgrade-247960 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (37.772138146s)
helpers_test.go:175: Cleaning up "running-upgrade-247960" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p running-upgrade-247960
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p running-upgrade-247960: (3.026127446s)
--- PASS: TestRunningBinaryUpgrade (87.19s)

                                                
                                    
x
+
TestKubernetesUpgrade (359.11s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-301368 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:222: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-301368 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m1.532486862s)
version_upgrade_test.go:227: (dbg) Run:  out/minikube-linux-arm64 stop -p kubernetes-upgrade-301368
version_upgrade_test.go:227: (dbg) Done: out/minikube-linux-arm64 stop -p kubernetes-upgrade-301368: (1.335884866s)
version_upgrade_test.go:232: (dbg) Run:  out/minikube-linux-arm64 -p kubernetes-upgrade-301368 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-linux-arm64 -p kubernetes-upgrade-301368 status --format={{.Host}}: exit status 7 (88.921073ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-301368 --memory=2200 --kubernetes-version=v1.31.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:243: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-301368 --memory=2200 --kubernetes-version=v1.31.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (4m45.686600435s)
version_upgrade_test.go:248: (dbg) Run:  kubectl --context kubernetes-upgrade-301368 version --output=json
version_upgrade_test.go:267: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:269: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-301368 --memory=2200 --kubernetes-version=v1.20.0 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:269: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p kubernetes-upgrade-301368 --memory=2200 --kubernetes-version=v1.20.0 --driver=docker  --container-runtime=containerd: exit status 106 (109.065213ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-301368] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19282
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.31.0-beta.0 cluster to v1.20.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.20.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-301368
	    minikube start -p kubernetes-upgrade-301368 --kubernetes-version=v1.20.0
	    
	    2) Create a second cluster with Kubernetes 1.20.0, by running:
	    
	    minikube start -p kubernetes-upgrade-3013682 --kubernetes-version=v1.20.0
	    
	    3) Use the existing cluster at version Kubernetes 1.31.0-beta.0, by running:
	    
	    minikube start -p kubernetes-upgrade-301368 --kubernetes-version=v1.31.0-beta.0
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:273: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:275: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-301368 --memory=2200 --kubernetes-version=v1.31.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:275: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-301368 --memory=2200 --kubernetes-version=v1.31.0-beta.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (7.873513895s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-301368" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubernetes-upgrade-301368
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p kubernetes-upgrade-301368: (2.366483656s)
--- PASS: TestKubernetesUpgrade (359.11s)

                                                
                                    
x
+
TestMissingContainerUpgrade (166.89s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:309: (dbg) Run:  /tmp/minikube-v1.26.0.2429279151 start -p missing-upgrade-562134 --memory=2200 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:309: (dbg) Done: /tmp/minikube-v1.26.0.2429279151 start -p missing-upgrade-562134 --memory=2200 --driver=docker  --container-runtime=containerd: (1m32.015267356s)
version_upgrade_test.go:318: (dbg) Run:  docker stop missing-upgrade-562134
version_upgrade_test.go:323: (dbg) Run:  docker rm missing-upgrade-562134
version_upgrade_test.go:329: (dbg) Run:  out/minikube-linux-arm64 start -p missing-upgrade-562134 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:329: (dbg) Done: out/minikube-linux-arm64 start -p missing-upgrade-562134 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m10.602206146s)
helpers_test.go:175: Cleaning up "missing-upgrade-562134" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p missing-upgrade-562134
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p missing-upgrade-562134: (2.247174394s)
--- PASS: TestMissingContainerUpgrade (166.89s)

                                                
                                    
x
+
TestPause/serial/Start (73.95s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-arm64 start -p pause-140561 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd
pause_test.go:80: (dbg) Done: out/minikube-linux-arm64 start -p pause-140561 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd: (1m13.950767038s)
--- PASS: TestPause/serial/Start (73.95s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.09s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-681063 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p NoKubernetes-681063 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd: exit status 14 (86.996107ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-681063] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19282
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.09s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (42.73s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-681063 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-681063 --driver=docker  --container-runtime=containerd: (42.354067231s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-681063 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (42.73s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (17.4s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-681063 --no-kubernetes --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-681063 --no-kubernetes --driver=docker  --container-runtime=containerd: (14.73282355s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-681063 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-arm64 -p NoKubernetes-681063 status -o json: exit status 2 (472.287259ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-681063","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-arm64 delete -p NoKubernetes-681063
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-arm64 delete -p NoKubernetes-681063: (2.192404791s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (17.40s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (7.98s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-681063 --no-kubernetes --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-681063 --no-kubernetes --driver=docker  --container-runtime=containerd: (7.981331866s)
--- PASS: TestNoKubernetes/serial/Start (7.98s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.26s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-681063 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-681063 "sudo systemctl is-active --quiet service kubelet": exit status 1 (262.335605ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.26s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (1.15s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (1.15s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.23s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-arm64 stop -p NoKubernetes-681063
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-arm64 stop -p NoKubernetes-681063: (1.231570405s)
--- PASS: TestNoKubernetes/serial/Stop (1.23s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (7.17s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-681063 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-681063 --driver=docker  --container-runtime=containerd: (7.173185551s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (7.17s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (6.97s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-arm64 start -p pause-140561 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
pause_test.go:92: (dbg) Done: out/minikube-linux-arm64 start -p pause-140561 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (6.955060223s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (6.97s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.36s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-681063 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-681063 "sudo systemctl is-active --quiet service kubelet": exit status 1 (361.139102ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.36s)

                                                
                                    
x
+
TestPause/serial/Pause (0.87s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-140561 --alsologtostderr -v=5
--- PASS: TestPause/serial/Pause (0.87s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.32s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p pause-140561 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p pause-140561 --output=json --layout=cluster: exit status 2 (324.179146ms)

                                                
                                                
-- stdout --
	{"Name":"pause-140561","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 7 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.33.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-140561","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.32s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.99s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-arm64 unpause -p pause-140561 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.99s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (1.2s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-140561 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-140561 --alsologtostderr -v=5: (1.201807227s)
--- PASS: TestPause/serial/PauseAgain (1.20s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (4.45s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p pause-140561 --alsologtostderr -v=5
E0717 20:13:15.878382  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p pause-140561 --alsologtostderr -v=5: (4.452045859s)
--- PASS: TestPause/serial/DeletePaused (4.45s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.12s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-140561
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-140561: exit status 1 (15.163868ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-140561: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (0.12s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (0.62s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (0.62s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (95.95s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run:  /tmp/minikube-v1.26.0.888441653 start -p stopped-upgrade-835156 --memory=2200 --vm-driver=docker  --container-runtime=containerd
E0717 20:16:06.522589  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 20:16:18.927669  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
version_upgrade_test.go:183: (dbg) Done: /tmp/minikube-v1.26.0.888441653 start -p stopped-upgrade-835156 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (32.491511065s)
version_upgrade_test.go:192: (dbg) Run:  /tmp/minikube-v1.26.0.888441653 -p stopped-upgrade-835156 stop
version_upgrade_test.go:192: (dbg) Done: /tmp/minikube-v1.26.0.888441653 -p stopped-upgrade-835156 stop: (20.020281951s)
version_upgrade_test.go:198: (dbg) Run:  out/minikube-linux-arm64 start -p stopped-upgrade-835156 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:198: (dbg) Done: out/minikube-linux-arm64 start -p stopped-upgrade-835156 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (43.433067157s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (95.95s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (1.29s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run:  out/minikube-linux-arm64 logs -p stopped-upgrade-835156
version_upgrade_test.go:206: (dbg) Done: out/minikube-linux-arm64 logs -p stopped-upgrade-835156: (1.291040458s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/false (4.7s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false
net_test.go:246: (dbg) Run:  out/minikube-linux-arm64 start -p false-058001 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd
net_test.go:246: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p false-058001 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd: exit status 14 (259.562906ms)

                                                
                                                
-- stdout --
	* [false-058001] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=19282
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on user configuration
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 20:19:24.077771  915172 out.go:291] Setting OutFile to fd 1 ...
	I0717 20:19:24.077971  915172 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 20:19:24.077978  915172 out.go:304] Setting ErrFile to fd 2...
	I0717 20:19:24.077984  915172 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0717 20:19:24.078247  915172 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19282-720845/.minikube/bin
	I0717 20:19:24.078746  915172 out.go:298] Setting JSON to false
	I0717 20:19:24.079716  915172 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":14512,"bootTime":1721233052,"procs":181,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1064-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
	I0717 20:19:24.079783  915172 start.go:139] virtualization:  
	I0717 20:19:24.083472  915172 out.go:177] * [false-058001] minikube v1.33.1 on Ubuntu 20.04 (arm64)
	I0717 20:19:24.086679  915172 out.go:177]   - MINIKUBE_LOCATION=19282
	I0717 20:19:24.086754  915172 notify.go:220] Checking for updates...
	I0717 20:19:24.091144  915172 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 20:19:24.095316  915172 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19282-720845/kubeconfig
	I0717 20:19:24.098214  915172 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19282-720845/.minikube
	I0717 20:19:24.101151  915172 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0717 20:19:24.103940  915172 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0717 20:19:24.107342  915172 config.go:182] Loaded profile config "force-systemd-flag-853759": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.30.2
	I0717 20:19:24.107559  915172 driver.go:392] Setting default libvirt URI to qemu:///system
	I0717 20:19:24.149945  915172 docker.go:123] docker version: linux-27.0.3:Docker Engine - Community
	I0717 20:19:24.150090  915172 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 20:19:24.239262  915172 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:37 OomKillDisable:true NGoroutines:53 SystemTime:2024-07-17 20:19:24.227191908 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1064-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214896640 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41 Expected:2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.15.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.28.1]] Warnings:<nil>}}
	I0717 20:19:24.239388  915172 docker.go:307] overlay module found
	I0717 20:19:24.242575  915172 out.go:177] * Using the docker driver based on user configuration
	I0717 20:19:24.245075  915172 start.go:297] selected driver: docker
	I0717 20:19:24.245097  915172 start.go:901] validating driver "docker" against <nil>
	I0717 20:19:24.245111  915172 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0717 20:19:24.248221  915172 out.go:177] 
	W0717 20:19:24.250753  915172 out.go:239] X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	I0717 20:19:24.253241  915172 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:88: 
----------------------- debugLogs start: false-058001 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: false-058001

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: false-058001

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: false-058001

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: false-058001

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: false-058001

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: false-058001

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: false-058001

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: false-058001

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: false-058001

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: false-058001

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: false-058001

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "false-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "false-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "false-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "false-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "false-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "false-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "false-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "false-058001" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "false-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "false-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "false-058001" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: false-058001

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "false-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-058001"

                                                
                                                
----------------------- debugLogs end: false-058001 [took: 4.224116198s] --------------------------------
helpers_test.go:175: Cleaning up "false-058001" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p false-058001
--- PASS: TestNetworkPlugins/group/false (4.70s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (175.31s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-069806 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0
E0717 20:21:06.519345  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 20:23:15.878388  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-069806 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.20.0: (2m55.313725455s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (175.31s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (73.37s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-385299 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-385299 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0: (1m13.374181399s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (73.37s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (9.8s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-069806 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [0366656a-5e32-428f-b40b-c0adb5f0527f] Pending
helpers_test.go:344: "busybox" [0366656a-5e32-428f-b40b-c0adb5f0527f] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [0366656a-5e32-428f-b40b-c0adb5f0527f] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 9.004628094s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-069806 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (9.80s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.4s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-069806 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-069806 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.228996251s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-069806 describe deploy/metrics-server -n kube-system
E0717 20:24:09.565351  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.40s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (12.4s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p old-k8s-version-069806 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p old-k8s-version-069806 --alsologtostderr -v=3: (12.400813127s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (12.40s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.21s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-069806 -n old-k8s-version-069806
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-069806 -n old-k8s-version-069806: exit status 7 (74.610025ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p old-k8s-version-069806 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.21s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (8.42s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-385299 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [cee8a525-29e4-40fa-90b9-f66405f43563] Pending
helpers_test.go:344: "busybox" [cee8a525-29e4-40fa-90b9-f66405f43563] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [cee8a525-29e4-40fa-90b9-f66405f43563] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 8.011517113s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-385299 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (8.42s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.18s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p no-preload-385299 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p no-preload-385299 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.035258315s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-385299 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.18s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (12.63s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p no-preload-385299 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p no-preload-385299 --alsologtostderr -v=3: (12.62491227s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (12.63s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.21s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-385299 -n no-preload-385299
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-385299 -n no-preload-385299: exit status 7 (73.542398ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p no-preload-385299 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.21s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (268.41s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-385299 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0
E0717 20:26:06.519462  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
E0717 20:28:15.878385  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-385299 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0: (4m28.020083199s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-385299 -n no-preload-385299
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (268.41s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5cc9f66cf4-d28kq" [efb40320-eec2-4b63-882e-efb3a943619b] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004896249s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (6.11s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5cc9f66cf4-d28kq" [efb40320-eec2-4b63-882e-efb3a943619b] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004583746s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-385299 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (6.11s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.25s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p no-preload-385299 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240715-585640e9
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.25s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (3.25s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p no-preload-385299 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-385299 -n no-preload-385299
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-385299 -n no-preload-385299: exit status 2 (340.326186ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-385299 -n no-preload-385299
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-385299 -n no-preload-385299: exit status 2 (314.327189ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p no-preload-385299 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-385299 -n no-preload-385299
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-385299 -n no-preload-385299
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.25s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (74.15s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-195036 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.2
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-195036 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.2: (1m14.147045785s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (74.15s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-cd95d586-bllqh" [c6f3ebc7-56c2-434d-943a-508cc33cf8da] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003938623s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.00s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.1s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-cd95d586-bllqh" [c6f3ebc7-56c2-434d-943a-508cc33cf8da] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.003470019s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-069806 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.10s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p old-k8s-version-069806 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240202-8f1494ea
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240715-585640e9
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.23s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (2.98s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p old-k8s-version-069806 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-069806 -n old-k8s-version-069806
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-069806 -n old-k8s-version-069806: exit status 2 (334.50422ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-069806 -n old-k8s-version-069806
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-069806 -n old-k8s-version-069806: exit status 2 (313.816939ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p old-k8s-version-069806 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-069806 -n old-k8s-version-069806
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-069806 -n old-k8s-version-069806
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (2.98s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (63.78s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-782689 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.2
E0717 20:31:06.520153  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-782689 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.2: (1m3.776837559s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (63.78s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (8.48s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-195036 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [5f33238d-97f3-45d9-8749-e9eb87f9d514] Pending
helpers_test.go:344: "busybox" [5f33238d-97f3-45d9-8749-e9eb87f9d514] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [5f33238d-97f3-45d9-8749-e9eb87f9d514] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 8.004230007s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-195036 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (8.48s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.75s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-195036 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-195036 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.590016165s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-195036 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.75s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (12.44s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p embed-certs-195036 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p embed-certs-195036 --alsologtostderr -v=3: (12.435462438s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (12.44s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.24s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-195036 -n embed-certs-195036
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-195036 -n embed-certs-195036: exit status 7 (82.237785ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p embed-certs-195036 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.24s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (269.31s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-195036 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.2
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-195036 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.2: (4m28.954902493s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-195036 -n embed-certs-195036
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (269.31s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.4s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-782689 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [1ec86001-d64e-4cf1-a874-ceee9d0e6f39] Pending
helpers_test.go:344: "busybox" [1ec86001-d64e-4cf1-a874-ceee9d0e6f39] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [1ec86001-d64e-4cf1-a874-ceee9d0e6f39] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 8.005293855s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-782689 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.40s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.3s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-782689 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-782689 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.182909004s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-782689 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.30s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (12.09s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p default-k8s-diff-port-782689 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p default-k8s-diff-port-782689 --alsologtostderr -v=3: (12.089114482s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (12.09s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.21s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-782689 -n default-k8s-diff-port-782689
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-782689 -n default-k8s-diff-port-782689: exit status 7 (68.393956ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p default-k8s-diff-port-782689 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.21s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (268.91s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-782689 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.2
E0717 20:32:58.928635  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
E0717 20:33:15.878452  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
E0717 20:33:58.981445  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:33:58.986708  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:33:58.997035  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:33:59.017306  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:33:59.057614  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:33:59.137896  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:33:59.298257  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:33:59.619150  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:34:00.260238  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:34:01.540475  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:34:04.101109  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:34:09.221333  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:34:19.461525  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:34:39.942228  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:34:52.433866  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
E0717 20:34:52.439840  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
E0717 20:34:52.450077  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
E0717 20:34:52.470350  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
E0717 20:34:52.510599  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
E0717 20:34:52.591134  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
E0717 20:34:52.751707  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
E0717 20:34:53.072301  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
E0717 20:34:53.712694  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
E0717 20:34:54.992884  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
E0717 20:34:57.553301  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
E0717 20:35:02.674040  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
E0717 20:35:12.914263  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
E0717 20:35:20.902425  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:35:33.394939  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
E0717 20:36:06.519656  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-782689 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.30.2: (4m28.423110056s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-782689 -n default-k8s-diff-port-782689
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (268.91s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-9gbl4" [d91d83f4-0d12-4ecb-8897-ec9b7dded584] Running
E0717 20:36:14.355809  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003669837s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.1s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-9gbl4" [d91d83f4-0d12-4ecb-8897-ec9b7dded584] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.004405046s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-195036 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.10s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.25s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p embed-certs-195036 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240715-585640e9
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240513-cd2ac642
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.25s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (3.19s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p embed-certs-195036 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-195036 -n embed-certs-195036
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-195036 -n embed-certs-195036: exit status 2 (331.223105ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-195036 -n embed-certs-195036
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-195036 -n embed-certs-195036: exit status 2 (349.318842ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p embed-certs-195036 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-195036 -n embed-certs-195036
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-195036 -n embed-certs-195036
--- PASS: TestStartStop/group/embed-certs/serial/Pause (3.19s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (38.89s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-690501 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0
E0717 20:36:42.822952  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-690501 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0: (38.888579491s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (38.89s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-8nd9b" [ec6ca1ac-41b6-46da-8b50-18d86fdd178c] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.010548452s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (6.16s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-779776cb65-8nd9b" [ec6ca1ac-41b6-46da-8b50-18d86fdd178c] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.005645707s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-782689 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (6.16s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.46s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-690501 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-690501 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.459704206s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.46s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (1.29s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p newest-cni-690501 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p newest-cni-690501 --alsologtostderr -v=3: (1.284947829s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (1.29s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.24s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-690501 -n newest-cni-690501
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-690501 -n newest-cni-690501: exit status 7 (69.782855ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p newest-cni-690501 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.24s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (24.67s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-690501 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-690501 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.31.0-beta.0: (24.176127392s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-690501 -n newest-cni-690501
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (24.67s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p default-k8s-diff-port-782689 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240715-585640e9
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240513-cd2ac642
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.29s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (3.39s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p default-k8s-diff-port-782689 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 pause -p default-k8s-diff-port-782689 --alsologtostderr -v=1: (1.182551322s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-782689 -n default-k8s-diff-port-782689
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-782689 -n default-k8s-diff-port-782689: exit status 2 (350.893354ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-782689 -n default-k8s-diff-port-782689
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-782689 -n default-k8s-diff-port-782689: exit status 2 (324.669624ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p default-k8s-diff-port-782689 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-782689 -n default-k8s-diff-port-782689
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-782689 -n default-k8s-diff-port-782689
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (3.39s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (87.81s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p auto-058001 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p auto-058001 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd: (1m27.807167794s)
--- PASS: TestNetworkPlugins/group/auto/Start (87.81s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.31s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 -p newest-cni-690501 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240715-f6ad1f6e
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240715-585640e9
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.31s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (3.83s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p newest-cni-690501 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-690501 -n newest-cni-690501
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-690501 -n newest-cni-690501: exit status 2 (400.547082ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-690501 -n newest-cni-690501
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-690501 -n newest-cni-690501: exit status 2 (391.87251ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p newest-cni-690501 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-690501 -n newest-cni-690501
E0717 20:37:36.276410  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-690501 -n newest-cni-690501
--- PASS: TestStartStop/group/newest-cni/serial/Pause (3.83s)
E0717 20:43:15.878421  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
E0717 20:43:27.188647  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/default-k8s-diff-port-782689/client.crt: no such file or directory
E0717 20:43:43.327202  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/auto-058001/client.crt: no such file or directory
E0717 20:43:43.332453  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/auto-058001/client.crt: no such file or directory
E0717 20:43:43.342703  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/auto-058001/client.crt: no such file or directory
E0717 20:43:43.362969  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/auto-058001/client.crt: no such file or directory
E0717 20:43:43.403251  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/auto-058001/client.crt: no such file or directory
E0717 20:43:43.483593  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/auto-058001/client.crt: no such file or directory
E0717 20:43:43.644036  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/auto-058001/client.crt: no such file or directory
E0717 20:43:43.964612  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/auto-058001/client.crt: no such file or directory
E0717 20:43:44.604968  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/auto-058001/client.crt: no such file or directory
E0717 20:43:45.885337  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/auto-058001/client.crt: no such file or directory
E0717 20:43:48.445559  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/auto-058001/client.crt: no such file or directory
E0717 20:43:53.565887  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/auto-058001/client.crt: no such file or directory

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (78.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kindnet-058001 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd
E0717 20:38:15.878667  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/addons-543596/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kindnet-058001 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd: (1m18.363023064s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (78.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p auto-058001 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (10.33s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-058001 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-t8ccr" [ca5c8ef7-a742-4ef6-8756-7efd1c3431de] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-t8ccr" [ca5c8ef7-a742-4ef6-8756-7efd1c3431de] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 10.004021162s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (10.33s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-058001 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-058001 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-058001 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-88ghv" [240195be-1c42-411a-9a19-5a3af682a46e] Running
E0717 20:38:58.981624  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 6.004058317s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kindnet-058001 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (10.41s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-058001 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-chmtr" [6fef177f-7584-4f8a-aa7e-0c00199885c3] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-chmtr" [6fef177f-7584-4f8a-aa7e-0c00199885c3] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 10.004158937s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (10.41s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-058001 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-058001 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-058001 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (81.81s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p calico-058001 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd
E0717 20:39:26.663449  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p calico-058001 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd: (1m21.805074183s)
--- PASS: TestNetworkPlugins/group/calico/Start (81.81s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (67.58s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-flannel-058001 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd
E0717 20:39:52.434379  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
E0717 20:40:20.116934  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/no-preload-385299/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-flannel-058001 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd: (1m7.584146139s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (67.58s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-b2jzl" [59585ef4-a525-4994-8895-61a6cf43b5ef] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 6.004595926s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p calico-058001 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (11.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-058001 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-9w9dd" [d5da5503-267e-4407-809f-47d491eca0b2] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-9w9dd" [d5da5503-267e-4407-809f-47d491eca0b2] Running
E0717 20:40:49.566291  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/functional-940017/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 11.004682481s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (11.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p custom-flannel-058001 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (10.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-058001 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-5q8k2" [4e872796-6eb5-414a-a3b5-fda2bd24fea6] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-5q8k2" [4e872796-6eb5-414a-a3b5-fda2bd24fea6] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 10.003933589s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (10.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-058001 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-058001 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-058001 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-058001 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-058001 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-058001 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (63.06s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p enable-default-cni-058001 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p enable-default-cni-058001 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd: (1m3.064804852s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (63.06s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (68.54s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p flannel-058001 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd
E0717 20:42:05.266349  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/default-k8s-diff-port-782689/client.crt: no such file or directory
E0717 20:42:05.271648  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/default-k8s-diff-port-782689/client.crt: no such file or directory
E0717 20:42:05.281809  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/default-k8s-diff-port-782689/client.crt: no such file or directory
E0717 20:42:05.302048  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/default-k8s-diff-port-782689/client.crt: no such file or directory
E0717 20:42:05.342289  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/default-k8s-diff-port-782689/client.crt: no such file or directory
E0717 20:42:05.422551  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/default-k8s-diff-port-782689/client.crt: no such file or directory
E0717 20:42:05.583328  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/default-k8s-diff-port-782689/client.crt: no such file or directory
E0717 20:42:05.903809  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/default-k8s-diff-port-782689/client.crt: no such file or directory
E0717 20:42:06.544552  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/default-k8s-diff-port-782689/client.crt: no such file or directory
E0717 20:42:07.825709  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/default-k8s-diff-port-782689/client.crt: no such file or directory
E0717 20:42:10.386119  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/default-k8s-diff-port-782689/client.crt: no such file or directory
E0717 20:42:15.506949  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/default-k8s-diff-port-782689/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p flannel-058001 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd: (1m8.536627197s)
--- PASS: TestNetworkPlugins/group/flannel/Start (68.54s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p enable-default-cni-058001 "pgrep -a kubelet"
E0717 20:42:25.747434  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/default-k8s-diff-port-782689/client.crt: no such file or directory
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (10.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-058001 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-44dx8" [aefe6906-b5b2-4669-87fd-5c73f678cc71] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-44dx8" [aefe6906-b5b2-4669-87fd-5c73f678cc71] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 10.003972029s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (10.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-spnhj" [0dc5d1e4-d8ae-41fc-a4e0-6b2ce8cf7682] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 6.00405095s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-058001 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-058001 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-058001 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p flannel-058001 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (9.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-058001 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-7gn7w" [0689e75e-3fbc-4230-876f-13b9fa35a396] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-6bc787d567-7gn7w" [0689e75e-3fbc-4230-876f-13b9fa35a396] Running
E0717 20:42:46.228472  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/default-k8s-diff-port-782689/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 9.018883773s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (9.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-058001 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-058001 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-058001 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (60.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p bridge-058001 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p bridge-058001 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd: (1m0.320343163s)
--- PASS: TestNetworkPlugins/group/bridge/Start (60.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p bridge-058001 "pgrep -a kubelet"
E0717 20:43:58.146979  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/kindnet-058001/client.crt: no such file or directory
E0717 20:43:58.152241  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/kindnet-058001/client.crt: no such file or directory
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (9.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-058001 replace --force -f testdata/netcat-deployment.yaml
E0717 20:43:58.162831  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/kindnet-058001/client.crt: no such file or directory
E0717 20:43:58.183224  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/kindnet-058001/client.crt: no such file or directory
E0717 20:43:58.223992  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/kindnet-058001/client.crt: no such file or directory
E0717 20:43:58.304763  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/kindnet-058001/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-6bc787d567-2p8gd" [17ec013e-b5d9-4135-8b41-f86a833f30e4] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0717 20:43:58.465704  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/kindnet-058001/client.crt: no such file or directory
E0717 20:43:58.786083  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/kindnet-058001/client.crt: no such file or directory
E0717 20:43:58.981601  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/old-k8s-version-069806/client.crt: no such file or directory
E0717 20:43:59.427046  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/kindnet-058001/client.crt: no such file or directory
E0717 20:44:00.708084  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/kindnet-058001/client.crt: no such file or directory
helpers_test.go:344: "netcat-6bc787d567-2p8gd" [17ec013e-b5d9-4135-8b41-f86a833f30e4] Running
E0717 20:44:03.268251  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/kindnet-058001/client.crt: no such file or directory
E0717 20:44:03.806468  726225 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19282-720845/.minikube/profiles/auto-058001/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 9.003597703s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (9.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-058001 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-058001 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.13s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-058001 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.14s)

                                                
                                    

Test skip (31/336)

x
+
TestDownloadOnly/v1.20.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.20.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.20.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.20.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.2/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.2/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.30.2/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.2/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.2/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.30.2/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.30.2/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.30.2/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.30.2/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.31.0-beta.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.31.0-beta.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.31.0-beta.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.31.0-beta.0/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.31.0-beta.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0.61s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:232: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p download-docker-561687 --alsologtostderr --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:244: Skip for arm64 platform. See https://github.com/kubernetes/minikube/issues/10144
helpers_test.go:175: Cleaning up "download-docker-561687" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p download-docker-561687
--- SKIP: TestDownloadOnlyKic (0.61s)

                                                
                                    
x
+
TestOffline (0s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:35: skipping TestOffline - only docker runtime supported on arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestOffline (0.00s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (0s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:446: skip Helm test on arm64
--- SKIP: TestAddons/parallel/HelmTiller (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:500: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerFlags (0s)

                                                
                                                
=== RUN   TestDockerFlags
docker_test.go:41: skipping: only runs with docker container runtime, currently testing containerd
--- SKIP: TestDockerFlags (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:45: Skip if arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1783: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DockerEnv
functional_test.go:459: only validate docker env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild (0s)

                                                
                                                
=== RUN   TestImageBuild
image_test.go:33: 
--- SKIP: TestImageBuild (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestSkaffold (0s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing containerd container runtime
--- SKIP: TestSkaffold (0.00s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.17s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-581181" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p disable-driver-mounts-581181
--- SKIP: TestStartStop/group/disable-driver-mounts (0.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet (4.5s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet
net_test.go:93: Skipping the test as containerd container runtimes requires CNI
panic.go:626: 
----------------------- debugLogs start: kubenet-058001 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-058001

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: kubenet-058001

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-058001

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: kubenet-058001

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: kubenet-058001

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: kubenet-058001

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: kubenet-058001

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: kubenet-058001

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: kubenet-058001

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: kubenet-058001

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: kubenet-058001

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "kubenet-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "kubenet-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "kubenet-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "kubenet-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "kubenet-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "kubenet-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "kubenet-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "kubenet-058001" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "kubenet-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "kubenet-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "kubenet-058001" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: kubenet-058001

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "kubenet-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-058001"

                                                
                                                
----------------------- debugLogs end: kubenet-058001 [took: 4.283431154s] --------------------------------
helpers_test.go:175: Cleaning up "kubenet-058001" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubenet-058001
--- SKIP: TestNetworkPlugins/group/kubenet (4.50s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (6.11s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:626: 
----------------------- debugLogs start: cilium-058001 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-058001" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-058001" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-058001" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-058001

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-058001" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-058001"

                                                
                                                
----------------------- debugLogs end: cilium-058001 [took: 5.774737828s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-058001" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cilium-058001
--- SKIP: TestNetworkPlugins/group/cilium (6.11s)

                                                
                                    
Copied to clipboard